Electronic device and method for operating screen capturing by electronic device

ABSTRACT

A method for operating capturing by an electronic device is provided. The method includes capturing a screen displayed on a display, extracting at least one region and/or block region from the captured screen, determining whether a command to modify the captured screen has been received, when it is determined that a command to modify the captured screen has been received, determining whether there is a region of interest (ROI) in the captured screen, based on the extracted at least one region and/or block region, and when the ROI exists, displaying a user interface for suggesting the region of interest.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application is based on and claims priority under 35 U.S.C. §119(a) of a Korean patent application number 10-2019-0129475, filed onOct. 17, 2019, in the Korean Intellectual Property Office, thedisclosure of which is incorporated by reference herein in its entirety.

BACKGROUND 1. Field

The disclosure relates to an electronic device and a method foroperating screen capturing by an electronic device.

2. Description of Related Art

As mobile communication and hardware/software technologies develop, aportable electronic device (hereinafter, an electronic device)represented by a smartphone has constantly evolved to have variousfunctions. An electronic device may include a touch screen-based displayto allow a user to easily access various functions, and may providescreens of various applications through the display.

Recently, an electronic device may provide a function allowing a user tocapture a screen being displayed on the display.

The above information is presented as background information only toassist with an understanding of the disclosure. No determination hasbeen made, and no assertion is made, as to whether any of the abovemight be applicable as prior art with regard to the disclosure.

SUMMARY

When a user captures a screen of an electronic device, there is aproblem in that an unintended screen is captured. In addition, if anunintended screen is captured, it is inconvenient for the user tocontrol the electronic device several times.

Aspects of the disclosure are to address at least the above-mentionedproblems and/or disadvantages and to provide at least the advantagesdescribed below. Accordingly, an aspect of the disclosure is to providean electronic device and a method for operating screen capturing by anelectronic device according to various embodiments of the disclosure, ascreen intended or desired by a user may be captured.

Additional aspects will be set forth in part in the description whichfollows and, in part, will be apparent from the description, or may belearned by practice of the presented embodiments.

In accordance with an aspect of the disclosure, a method for operatingcapturing by an electronic device is provided. The method includescapturing a screen displayed on a display, extracting at least oneregion and/or block region from the captured screen, determining whethera command to modify the captured screen has been received, when it isdetermined that a command to modify the captured screen has beenreceived, determining whether there is a region of interest (ROI) in thecaptured screen, based on the extracted at least one region and/or blockregion, and when the region of interest (ROI) exists, displaying a userinterface for suggesting the region of interest.

In accordance with another aspect of the disclosure, an electronicdevice is provided. The electronic device includes a display, aprocessor operatively connected to the display, and a memory operativelyconnected to the processor, wherein the memory stores instructionswhich, when executed, cause the processor to capture a screen displayedon a display, extract at least one region and/or block region from thecaptured screen, determine whether a command to modify the capturedscreen has been received, when it is determined that a command to modifythe captured screen has been received, determine whether there is aregion of interest (ROI) in the captured screen, based on the extractedat least one region and/or block region, and when the region of interest(ROI) exists, display a user interface for suggesting the region ofinterest.

In an electronic device and a method for operating screen capturing byan electronic device according to various embodiments of the disclosure,a user interface for capturing a screen intended or desired by a usermay be provided to improve a user experience.

In an electronic device and a method for operating screen capturing byan electronic device according to various embodiments of the disclosure,a user interface for capturing a screen intended or desired by a usermay be provided to reduce the inconvenience of the user who has tocontrol the electronic device several times to capture the screen.

Other aspects, advantages, and salient features of the disclosure willbecome apparent to those skilled in the art from the following detaileddescription, which, taken in conjunction with the annexed drawings,discloses various embodiments of the disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features, and advantages, of certainembodiments of the disclosure will be more apparent from the followingdescription taken in conjunction with the accompanying drawings, inwhich:

FIG. 1 is a block diagram of an electronic device in a networkenvironment according to an embodiment of the disclosure;

FIG. 2A illustrates an open state of an electronic device according toan embodiment of the disclosure;

FIG. 2B illustrates a folded state of an electronic device illustratedin FIG. 2A according to an embodiment of the disclosure;

FIG. 3A is a perspective view of a front surface of a mobile electronicdevice according to an embodiment of the disclosure;

FIG. 3B is a perspective view of a rear surface of an electronic deviceillustrated in FIG. 3A according to an embodiment of the disclosure;

FIG. 4 illustrates a software structure of an electronic deviceaccording to an embodiment of the disclosure;

FIG. 5 is a block diagram illustrating a drawing engine of an electronicdevice according to an embodiment of the disclosure;

FIG. 6 is a flowchart illustrating a method for operating capturing byan electronic device according to an embodiment of the disclosure;

FIG. 7 is a flowchart illustrating an operation of capturing a displayedprocess screen by an electronic device according to an embodiment of thedisclosure;

FIG. 8 is a flowchart illustrating an operation of extracting additionalinformation according to a displayed process in an electronic deviceaccording to an embodiment of the disclosure;

FIG. 9 is a flowchart illustrating a method for operating capturing byan electronic device according to an embodiment of the disclosure;

FIG. 10 is a flowchart illustrating an operation of modifying a capturedscreen by an electronic device according to an embodiment of thedisclosure;

FIG. 11 is a flowchart illustrating an operation of capturing adisplayed process screen by an electronic device according to anembodiment of the disclosure;

FIG. 12 is a flowchart illustrating an editing operation of anelectronic device according to a user input according to an embodimentof the disclosure;

FIG. 13 is a flowchart illustrating an editing operation of anelectronic device according to a user input according to an embodimentof the disclosure;

FIG. 14 is a flowchart illustrating a method for operating capturing byan electronic device according to an embodiment of the disclosure;

FIG. 15 is a flowchart illustrating a method for operating capturing byan electronic device according to an embodiment of the disclosure;

FIG. 16 is a flowchart illustrating a method for operating capturing byan electronic device according to an embodiment of the disclosure;

FIG. 17A is a diagram illustrating an operation of extracting additionalinformation according to a displayed process by an electronic deviceaccording to an embodiment of the disclosure;

FIG. 17B is a diagram illustrating an operation of suggesting a regionof interest (ROI) by an electronic device according to an embodiment ofthe disclosure;

FIG. 18 is a diagram illustrating an operation of modifying a capturedscreen by an electronic device according to an embodiment of thedisclosure;

FIG. 19 is a diagram illustrating an operation of modifying a capturedscreen by an electronic device according to an embodiment of thedisclosure;

FIG. 20 is a diagram illustrating an editing operation of an electronicdevice according to a user input according to an embodiment of thedisclosure;

FIG. 21 is a diagram illustrating an editing operation of an electronicdevice according to a user input according to an embodiment of thedisclosure;

FIG. 22 is a diagram illustrating an editing operation of an electronicdevice according to a user input according to an embodiment of thedisclosure;

FIG. 23 is a diagram illustrating an editing operation of an electronicdevice according to a user input according to an embodiment of thedisclosure;

FIG. 24 is a diagram illustrating an operation of capturing a displayedprocess screen by an electronic device according to an embodiment of thedisclosure;

FIG. 25 is a diagram illustrating an operation of capturing a displayedprocess screen by an electronic device according to an embodiment of thedisclosure;

FIG. 26 is a diagram illustrating an operation of capturing a displayedprocess screen by an electronic device according to an embodiment of thedisclosure;

FIG. 27 is a diagram illustrating an operation of capturing a displayedprocess screen by an electronic device according to an embodiment of thedisclosure;

FIG. 28 is a diagram illustrating a method for operating capturing by anelectronic device according to an embodiment of the disclosure;

FIG. 29 is a diagram illustrating a method for operating capturing by anelectronic device according to an embodiment of the disclosure;

FIG. 30 illustrates a sequence of an editing operation of an electronicdevice according to a user input according to an embodiment of thedisclosure;

FIG. 31 illustrates a sequence of an editing operation of an electronicdevice according to a user input according to an embodiment of thedisclosure;

FIG. 32A is a diagram illustrating a method for operating capturing byan electronic device according to an embodiment of the disclosure;

FIG. 32B is a diagram illustrating a method for operating capturing byan electronic device according to an embodiment of the disclosure;

FIG. 33 is a diagram illustrating a method for operating capturing by anelectronic device according to an embodiment of the disclosure;

FIG. 34 is a diagram illustrating a method for operating capturing by anelectronic device according to an embodiment of the disclosure;

FIG. 35 is a diagram illustrating capturing operated by an electronicdevice according to an embodiment of the disclosure;

FIG. 36 is a diagram illustrating capturing operated by an electronicdevice according to an embodiment of the disclosure;

FIG. 37 is a diagram illustrating capturing operated by an electronicdevice according to an embodiment of the disclosure;

FIG. 38 is a diagram illustrating capturing operated by an electronicdevice according to an embodiment of the disclosure;

FIG. 39 is a diagram illustrating an operation of selecting an objectregion to capture a screen by an electronic device according to anembodiment of the disclosure;

FIG. 40 is a diagram illustrating an operation of selecting an objectregion to capture a screen by an electronic device according to anembodiment of the disclosure;

FIG. 41 is a diagram illustrating an operation of capturing the entirescreen by an electronic device according to an embodiment of thedisclosure;

FIG. 42 is a diagram illustrating an operation of capturing the entirescreen by an electronic device according to an embodiment of thedisclosure; and

FIG. 43 is a flowchart illustrating a method for operating capturing byan electronic device according to an embodiment of the disclosure.

Throughout the drawings, like reference numerals will be understood torefer to like parts, components, and structures.

DETAILED DESCRIPTION

The following description with reference to the accompanying drawings isprovided to assist in a comprehensive understanding of variousembodiments of the disclosure as defined by the claims and theirequivalents. It includes various specific details to assist in thatunderstanding but these are to be regarded as merely exemplary.Accordingly, those of ordinary skill in the art will recognize thatvarious changes and modifications of the various embodiments describedherein can be made without departing from the scope and spirit of thedisclosure. In addition, descriptions of well-known functions andconstructions may be omitted for clarity and conciseness.

The terms and words used in the following description and claims are notlimited to the bibliographical meanings, but, are merely used by theinventor to enable a clear and consistent understanding of thedisclosure. Accordingly, it should be apparent to those skilled in theart that the following description of various embodiments of thedisclosure is provided for illustration purpose only and not for thepurpose of limiting the disclosure as defined by the appended claims andtheir equivalents.

It is to be understood that the singular forms “a,” “an,” and “the”include plural referents unless the context clearly dictates otherwise.Thus, for example, reference to “a component surface” includes referenceto one or more of such surfaces.

FIG. 1 is a block diagram illustrating an electronic device 101 in anetwork environment 100 according to an embodiment of the disclosure.

Referring to FIG. 1 , the electronic device 101 in the networkenvironment 100 may communicate with an electronic device 102 via afirst network 198 (e.g., a short-range wireless communication network),or an electronic device 104 or a server 108 via a second network 199(e.g., a long-range wireless communication network). According to anembodiment of the disclosure, the electronic device 101 may communicatewith the electronic device 104 via the server 108. According to anembodiment of the disclosure, the electronic device 101 may include aprocessor 120, memory 130, an input device 150, a sound output device155, a display device 160, an audio module 170, a sensor module 176, aninterface 177, a haptic module 179, a camera module 180, a powermanagement module 188, a battery 189, a communication module 190, asubscriber identification module (SIM) 196, or an antenna module 197. Insome embodiments of the disclosure, at least one (e.g., the displaydevice 160 or the camera module 180) of the components may be omittedfrom the electronic device 101, or one or more other components may beadded in the electronic device 101. In some embodiments of thedisclosure, some of the components may be implemented as singleintegrated circuitry. For example, the sensor module 176 (e.g., afingerprint sensor, an iris sensor, or an illuminance sensor) may beimplemented as embedded in the display device 160 (e.g., a display).

The processor 120 may execute, for example, software (e.g., a program140) to control at least one other component (e.g., a hardware orsoftware component) of the electronic device 101 coupled with theprocessor 120, and may perform various data processing or computation.According to one embodiment of the disclosure, as at least part of thedata processing or computation, the processor 120 may load a command ordata received from another component (e.g., the sensor module 176 or thecommunication module 190) in volatile memory 132, process the command orthe data stored in the volatile memory 132, and store resulting data innon-volatile memory 134. According to an embodiment of the disclosure,the processor 120 may include a main processor 121 (e.g., a centralprocessing unit (CPU) or an application processor (AP)), and anauxiliary processor 123 (e.g., a graphics processing unit (GPU), animage signal processor (ISP), a sensor hub processor, or a communicationprocessor (CP)) that is operable independently from, or in conjunctionwith, the main processor 121. Additionally or alternatively, theauxiliary processor 123 may be adapted to consume less power than themain processor 121, or to be specific to a specified function. Theauxiliary processor 123 may be implemented as separate from, or as partof the main processor 121.

The auxiliary processor 123 may control at least some of functions orstates related to at least one component (e.g., the display device 160,the sensor module 176, or the communication module 190) among thecomponents of the electronic device 101, instead of the main processor121 while the main processor 121 is in an inactive (e.g., sleep) state,or together with the main processor 121 while the main processor 121 isin an active state (e.g., executing an application). According to anembodiment of the disclosure, the auxiliary processor 123 (e.g., animage signal processor or a communication processor) may be implementedas part of another component (e.g., the camera module 180 or thecommunication module 190) functionally related to the auxiliaryprocessor 123.

The memory 130 may store various data used by at least one component(e.g., the processor 120 or the sensor module 176) of the electronicdevice 101. The various data may include, for example, software (e.g.,the program 140) and input data or output data for a command relatedthereto. The memory 130 may include the volatile memory 132 or thenon-volatile memory 134.

The program 140 may be stored in the memory 130 as software, and mayinclude, for example, an operating system (OS) 142, middleware 144, oran application 146.

The input device 150 may receive a command or data to be used by othercomponent (e.g., the processor 120) of the electronic device 101, fromthe outside (e.g., a user) of the electronic device 101. The inputdevice 150 may include, for example, a microphone, a mouse, a keyboard,or a digital pen (e.g., a stylus pen).

The sound output device 155 may output sound signals to the outside ofthe electronic device 101. The sound output device 155 may include, forexample, a speaker or a receiver. The speaker may be used for generalpurposes, such as playing multimedia or playing record, and the receivermay be used for an incoming calls. According to an embodiment of thedisclosure, the receiver may be implemented as separate from, or as partof the speaker.

The display device 160 may visually provide information to the outside(e.g., a user) of the electronic device 101. The display device 160 mayinclude, for example, a display, a hologram device, or a projector andcontrol circuitry to control a corresponding one of the display,hologram device, and projector. According to an embodiment of thedisclosure, the display device 160 may include touch circuitry adaptedto detect a touch, or sensor circuitry (e.g., a pressure sensor) adaptedto measure the intensity of force incurred by the touch.

The audio module 170 may convert a sound into an electrical signal andvice versa. According to an embodiment of the disclosure, the audiomodule 170 may obtain the sound via the input device 150, or output thesound via the sound output device 155 or a headphone of an externalelectronic device (e.g., an electronic device 102) directly (e.g.,wiredly) or wirelessly coupled with the electronic device 101.

The sensor module 176 may detect an operational state (e.g., power ortemperature) of the electronic device 101 or an environmental state(e.g., a state of a user) external to the electronic device 101, andthen generate an electrical signal or data value corresponding to thedetected state. According to an embodiment of the disclosure, the sensormodule 176 may include, for example, a gesture sensor, a gyro sensor, anatmospheric pressure sensor, a magnetic sensor, an acceleration sensor,a grip sensor, a proximity sensor, a color sensor, an infrared (IR)sensor, a biometric sensor, a temperature sensor, a humidity sensor, oran illuminance sensor.

The interface 177 may support one or more specified protocols to be usedfor the electronic device 101 to be coupled with the external electronicdevice (e.g., the electronic device 102) directly (e.g., wiredly) orwirelessly. According to an embodiment of the disclosure, the interface177 may include, for example, a high definition multimedia interface(HDMI), a universal serial bus (USB) interface, a secure digital (SD)card interface, or an audio interface.

A connecting terminal 178 may include a connector via which theelectronic device 101 may be physically connected with the externalelectronic device (e.g., the electronic device 102). According to anembodiment of the disclosure, the connecting terminal 178 may include,for example, a HDMI connector, a USB connector, a SD card connector, oran audio connector (e.g., a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanicalstimulus (e.g., a vibration or a movement) or electrical stimulus whichmay be recognized by a user via his tactile sensation or kinestheticsensation. According to an embodiment of the disclosure, the hapticmodule 179 may include, for example, a motor, a piezoelectric element,or an electric stimulator.

The camera module 180 may capture a still image or moving images.According to an embodiment of the disclosure, the camera module 180 mayinclude one or more lenses, image sensors, image signal processors, orflashes.

The power management module 188 may manage power supplied to theelectronic device 101. According to one embodiment of the disclosure,the power management module 188 may be implemented as at least part of,for example, a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of theelectronic device 101. According to an embodiment of the disclosure, thebattery 189 may include, for example, a primary cell which is notrechargeable, a secondary cell which is rechargeable, or a fuel cell.

The communication module 190 may support establishing a direct (e.g.,wired) communication channel or a wireless communication channel betweenthe electronic device 101 and the external electronic device (e.g., theelectronic device 102, the electronic device 104, or the server 108) andperforming communication via the established communication channel. Thecommunication module 190 may include one or more communicationprocessors that are operable independently from the processor 120 (e.g.,the application processor (AP)) and supports a direct (e.g., wired)communication or a wireless communication. According to an embodiment ofthe disclosure, the communication module 190 may include a wirelesscommunication module 192 (e.g., a cellular communication module, ashort-range wireless communication module, or a global navigationsatellite system (GNSS) communication module) or a wired communicationmodule 194 (e.g., a local area network (LAN) communication module or apower line communication (PLC) module). A corresponding one of thesecommunication modules may communicate with the external electronicdevice via the first network 198 (e.g., a short-range communicationnetwork, such as Bluetooth™, wireless-fidelity (Wi-Fi) direct, orinfrared data association (IrDA)) or the second network 199 (e.g., along-range communication network, such as a cellular network, theInternet, or a computer network (e.g., LAN or wide area network (WAN)).These various types of communication modules may be implemented as asingle component (e.g., a single chip), or may be implemented as multicomponents (e.g., multi chips) separate from each other. The wirelesscommunication module 192 may identify and authenticate the electronicdevice 101 in a communication network, such as the first network 198 orthe second network 199, using subscriber information (e.g.,international mobile subscriber identity (IMSI)) stored in thesubscriber identification module 196.

The antenna module 197 may transmit or receive a signal or power to orfrom the outside (e.g., the external electronic device) of theelectronic device 101. According to an embodiment of the disclosure, theantenna module 197 may include an antenna including a radiating elementincluding a conductive material or a conductive pattern formed in or ona substrate (e.g., printed circuit board (PCB)). According to anembodiment of the disclosure, the antenna module 197 may include aplurality of antennas. In such a case, at least one antenna appropriatefor a communication scheme used in the communication network, such asthe first network 198 or the second network 199, may be selected, forexample, by the communication module 190 (e.g., the wirelesscommunication module 192) from the plurality of antennas. The signal orthe power may then be transmitted or received between the communicationmodule 190 and the external electronic device via the selected at leastone antenna. According to an embodiment of the disclosure, anothercomponent (e.g., a radio frequency integrated circuit (RFIC)) other thanthe radiating element may be additionally formed as part of the antennamodule 197.

At least some of the above-described components may be coupled mutuallyand communicate signals (e.g., commands or data) therebetween via aninter-peripheral communication scheme (e.g., a bus, general purposeinput and output (GPIO), serial peripheral interface (SPI), or mobileindustry processor interface (MIPI)).

According to an embodiment of the disclosure, commands or data may betransmitted or received between the electronic device 101 and theexternal electronic device 104 via the server 108 coupled with thesecond network 199. Each of the electronic devices 102 and 104 may be adevice of a same type as, or a different type, from the electronicdevice 101. According to an embodiment of the disclosure, all or some ofoperations to be executed at the electronic device 101 may be executedat one or more of the external electronic devices 102, 104, or 108. Forexample, if the electronic device 101 should perform a function or aservice automatically, or in response to a request from a user oranother device, the electronic device 101, instead of, or in additionto, executing the function or the service, may request the one or moreexternal electronic devices to perform at least part of the function orthe service. The one or more external electronic devices receiving therequest may perform the at least part of the function or the servicerequested, or an additional function or an additional service related tothe request, and transfer an outcome of the performing to the electronicdevice 101. The electronic device 101 may provide the outcome, with orwithout further processing of the outcome, as at least part of a replyto the request. To that end, a cloud computing, distributed computing,or client-server computing technology may be used, for example.

The electronic device according to various embodiments may be one ofvarious types of electronic devices. The electronic devices may include,for example, a portable communication device (e.g., a smartphone), acomputer device, a portable multimedia device, a portable medicaldevice, a camera, a wearable device, or a home appliance. According toan embodiment of the disclosure, the electronic devices are not limitedto those described above.

It should be appreciated that various embodiments of the disclosure andthe terms used therein are not intended to limit the technologicalfeatures set forth herein to particular embodiments and include variouschanges, equivalents, or replacements for a corresponding embodiment.With regard to the description of the drawings, similar referencenumerals may be used to refer to similar or related elements. It is tobe understood that a singular form of a noun corresponding to an itemmay include one or more of the things, unless the relevant contextclearly indicates otherwise. As used herein, each of such phrases as “Aor B,” “at least one of A and B,” “at least one of A or B,” “A, B, orC,” “at least one of A, B, and C,” and “at least one of A, B, or C,” mayinclude any one of, or all possible combinations of the items enumeratedtogether in a corresponding one of the phrases. As used herein, suchterms as “1st” and “2nd,” or “first” and “second” may be used to simplydistinguish a corresponding component from another, and does not limitthe components in other aspect (e.g., importance or order). It is to beunderstood that if an element (e.g., a first element) is referred to,with or without the term “operatively” or “communicatively”, as “coupledwith,” “coupled to,” “connected with,” or “connected to” another element(e.g., a second element), it means that the element may be coupled withthe other element directly (e.g., wiredly), wirelessly, or via a thirdelement.

As used herein, the term “module” may include a unit implemented inhardware, software, or firmware, and may interchangeably be used withother terms, for example, “logic,” “logic block,” “part,” or“circuitry”. A module may be a single integral component, or a minimumunit or part thereof, adapted to perform one or more functions. Forexample, according to an embodiment of the disclosure, the module may beimplemented in a form of an application-specific integrated circuit(ASIC).

Various embodiments as set forth herein may be implemented as software(e.g., the program 140) including one or more instructions that arestored in a storage medium (e.g., internal memory 136 or external memory138) that is readable by a machine (e.g., the electronic device 101).For example, a processor (e.g., the processor 120) of the machine (e.g.,the electronic device 101) may invoke at least one of the one or moreinstructions stored in the storage medium, and execute it, with orwithout using one or more other components under the control of theprocessor. This allows the machine to be operated to perform at leastone function according to the at least one instruction invoked. The oneor more instructions may include a code generated by a complier or acode executable by an interpreter. The machine-readable storage mediummay be provided in the form of a non-transitory storage medium. Wherein,the term “non-transitory” simply means that the storage medium is atangible device, and does not include a signal (e.g., an electromagneticwave), but this term does not differentiate between where data issemi-permanently stored in the storage medium and where the data istemporarily stored in the storage medium.

According to an embodiment of the disclosure, a method according tovarious embodiments of the disclosure may be included and provided in acomputer program product. The computer program product may be traded asa product between a seller and a buyer. The computer program product maybe distributed in the form of a machine-readable storage medium (e.g.,compact disc read only memory (CD-ROM)), or be distributed (e.g.,downloaded or uploaded) online via an application store (e.g.,PlayStore™), or between two user devices (e.g., smart phones) directly.If distributed online, at least part of the computer program product maybe temporarily generated or at least temporarily stored in themachine-readable storage medium, such as memory of the manufacturer'sserver, a server of the application store, or a relay server.

According to various embodiments of the disclosure, each component(e.g., a module or a program) of the above-described components mayinclude a single entity or multiple entities. According to variousembodiments of the disclosure, one or more of the above-describedcomponents may be omitted, or one or more other components may be added.Alternatively or additionally, a plurality of components (e.g., modulesor programs) may be integrated into a single component. In such a case,according to various embodiments of the disclosure, the integratedcomponent may still perform one or more functions of each of theplurality of components in the same or similar manner as they areperformed by a corresponding one of the plurality of components beforethe integration. According to various embodiments of the disclosure,operations performed by the module, the program, or another componentmay be carried out sequentially, in parallel, repeatedly, orheuristically, or one or more of the operations may be executed in adifferent order or omitted, or one or more other operations may beadded.

At least a part of the elements described above may be connected to eachother through a communication scheme between surrounding devices (e.g.,a bus, a general purpose input and output (GPIO), a serial peripheralinterface (SPI), or a mobile industry processor interface (MIPI)), andmay exchange a signal (e.g., a command or data) with each other.

According to an embodiment of the disclosure, a command or data may betransmitted or received between an electronic device 101 and theexternal electronic device 104 through the server 108 connected to thesecond network 199. Each of the electronic devices 102 and 104 may be adevice that is of a type identical to or different from that of theelectronic device 101. According to an embodiment of the disclosure, allor a part of the operations executed in the electronic device 101 may beexecuted in one or more external electronic devices among the externalelectronic devices 102, 104, or 108. For example, in a case where theelectronic device 101 is required to perform a function or serviceautomatically or in response to a request from a user or another device,the electronic device 101 may request one or more external electronicdevices to perform at least a part of the function or service, inaddition to or instead of executing the function or service by itself.The one or more external electronic devices having received the requestmay execute at least a part of the requested function or service, or anadditional function or service related to the request, and may transfera result of the execution to the electronic device 101. The electronicdevice 101 may process the result additionally or without change, andmay provide the processed result as at least a part of a response forthe request. To this end, for example, cloud computing, distributedcomputing, or client-server computing technologies may be used.

FIG. 2A illustrates an open state of an electronic device according toan embodiment of the disclosure.

FIG. 2B illustrates a folded state of an electronic device illustratedin FIG. 2A according to an embodiment of the disclosure.

Referring to FIG. 2A, an electronic device 200 (e.g., the electronicdevice 101 in FIG. 1 ) may include a first housing structure 210 and asecond housing structure 220 including at least one space in which atleast one display can be disposed, at least one display 230 (e.g., aflexible display, a foldable display, or a first display) disposed inthe at least one space, a second display (e.g., a sub-display) disposedon one surface of the second housing structure 220, a hinge structure(e.g., the hinge structure 265 in FIG. 2A) allowing the first housingstructure 210 and the second housing structure 220 to be folded witheach other, and a hinge cover (e.g., the hinge cover 265 in FIG. 2A)configured to cover a part allowing the first housing structure 210 andthe second housing structure 220 to be foldable. In the specification,the surface on which the first display 230 is disposed may be defined asthe front surface of the electronic device 200, and the opposite surfaceto the front surface may be defined as the rear surface of theelectronic device 200. In addition, the surface surrounding a spacebetween the front surface and the rear surface may be defined as theside surface of the electronic device 200.

In an embodiment of the disclosure, a pair of housing structures 210 and220 may include the first housing structure 210 including a sensorregion 231 d, the second housing structure 220, a first rear surfacecover 240, and a second rear surface cover 250. The pair of housingstructures 210 and 220 of the electronic device 200 is not limited tothe shape and coupling illustrated in FIGS. 2A and 2B, and may beimplemented by a combination and/or coupling of different shapes orcomponents. For example, in another embodiment of the disclosure, thefirst housing structure 210 and the first rear surface cover 240 may beintegrally formed, and the second housing structure 220 and the secondrear surface cover 250 may be integrally formed.

According to an embodiment of the disclosure, the first housingstructure 210 and the second housing structure 220 may be configured tobe a single housing (not illustrated), a folded part of the singlehousing may be made of a flexible material (not illustrated), and thehinge structure 265 may be not configured separately but replaced with aflexible material. According to an embodiment of the disclosure, thefirst housing structure 210 and the second housing structure 220 may bearranged at both sides with respect to a folding axis (A axis), and maybe folded or unfolded with respect to the folding axis (A axis).According to an embodiment of the disclosure, the angle or distancebetween the first housing structure 210 and the second housing structure220 may be different according to whether the electronic device 200 isin an open state (flat state), a folded state, or an intermediate state.At least a partial region of the first housing structure 210 or thesecond housing structure 220 may include the sensor region 231 d inwhich various sensors are arranged. As another example, the sensorarrangement region 231 d may additionally be disposed or replaced to bein at least a partial region of the second housing structure 220.

According to an embodiment of the disclosure, the angle between thefirst housing structure 210 and the second housing structure 220 may beadjusted by the hinge structure (e.g., the hinge structure 265 in FIG.2A). According to an embodiment of the disclosure, when the firsthousing structure 210 and the second housing structure 220 are orientedtoward the same surface (e.g., the front surface), or are parallel tothe same axis (X axis), the electronic device 200 may be considered tobe in an open state. According to an embodiment of the disclosure, inthe electronic device 200, the first display 230 may be disposed in aspace formed by the first housing structure 210 and the second housingstructure 220. The first display 230 may include a first surface 211 anda third surface 221. A flexible region allowing the first display to bebent at a predetermined angle may be formed between the first surface211 and the third surface 221. According to an embodiment of thedisclosure, the first display 230, at least a partial region of whichcan be bent, may have a region which can be bent in various shapes inaddition to the first surface 211 and the third surface 221, and thenumber of bendable regions is not limited to one. According to variousembodiments of the disclosure, the hinge structure (e.g., the hingestructure 265 in FIG. 2A) may be disposed in a region in which the firstdisplay 230 can be bent. When the first display 230 is bent, the hingestructure may support the first display 230 to maintain an angle in thestate where the first display is bent.

According to an embodiment of the disclosure, the first housingstructure 210 may include a first surface 211 oriented toward the frontsurface, a second surface 212 oriented toward the opposite direction tothe first surface 211, and a first side surface member 213 surroundingat least a part of a space between the first surface 211 and the secondsurface 212. In an embodiment of the disclosure, the first side surfacemember 213 may include a first side surface 213 a disposed in parallelwith a folding axis (A axis), a second side surface 213 b extending fromone end of the first side surface 213 a in a direction perpendicular tothe folding axis, and a third side surface 213 c extending from theother end of the first side surface 213 a in a direction perpendicularto the folding axis (A axis).

In an embodiment of the disclosure, at least a part of the secondhousing structure 220 may be connected to the hinge structure (e.g., thehinge structure 265 in FIG. 2A), and the second housing structure 220may include a third surface 221 oriented toward the front surface of theelectronic device 200, a fourth surface 222 oriented in the oppositedirection to the third surface 221, and a second side surface member 223surrounding at least a part of a space between the third surface 221 andthe fourth surface 222. In an embodiment of the disclosure, the secondside surface member 223 may include a fourth side surface 223 a disposedin parallel with the folding axis (A axis), a fifth side surface 223 bextending from one end of the fourth side surface 223 a in a directionperpendicular to the folding axis, and a sixth side surface 223 cextending from the other end of the fourth side surface 223 a in adirection perpendicular to the folding axis (A axis). In an embodimentof the disclosure, the third surface 221 may face the first surface 211to be opposite thereto in a folded state.

In an embodiment of the disclosure, the electronic device 200 mayinclude a recess 201 that is configured to receive the first display230, at least a part of which can be bent, and is formed throughstructural shape coupling between the first housing structure 210 andthe second housing structure 220. According to an embodiment of thedisclosure, the recess 201 may have substantially the same size as thatof the first display 230. In an embodiment of the disclosure, the recess201 may have two or more different widths in a direction perpendicularto the folding axis (A axis) due to the sensor region 231 d. Forexample, the recess 201 may have a first width W1 between a first part220 a of the second housing structure 220 and a first part 210 adisposed at the periphery of the sensor region 231 d in the firsthousing structure 210. The recess may have a second width W2 by a secondpart 220 b of the second housing structure 210 and a second part 210 bthat does not correspond to the sensor region 231 d and is parallel tothe folding axis (A axis) in the first housing structure 210. Accordingto various embodiments of the disclosure, the width of the recess 201may not be limited to the illustrated example. According to variousembodiments of the disclosure, the recess 201 may have two or moredifferent widths, or the same width.

In an embodiment of the disclosure, at least a part of the first housingstructure 210 and the second housing structure 220 may be made of ametal or non-metal material having a selected rigidity to support thefirst display 230.

In an embodiment of the disclosure, the sensor region 231 d may beadjacent to one corner of the first housing structure 210 and have apredetermined region. The arrangement, shape, or size of the sensorregion 231 d may not be limited to the illustrated example. According tovarious embodiments of the disclosure, at least one of a front cameradevice, a receiver, a proximity sensor, an ultrasonic sensor, a gesturesensor, a gyro sensor, an atmospheric pressure sensor, a magneticsensor, an acceleration sensor, a grip sensor, a color sensor, aninfrared (IR) sensor, a biometric sensor, a temperature sensor, ahumidity sensor, or an indicator may be disposed in at least a partialregion of the sensor region 231 d. In various embodiments of thedisclosure, the components may be disposed in the electronic devicewithout a separate sensor region. For example, at least a part of thecomponents may be arranged under the first display 230, or may be seenthrough a partial region of the first display 230.

In an embodiment of the disclosure, the first rear surface cover 240 maybe disposed on the second surface 212 of the first housing structure210, and may have substantially a rectangular periphery. In anembodiment of the disclosure, at least a part of the periphery may besurrounded by the first housing structure 210. Similarly, the secondrear surface cover 250 may be disposed on the fourth surface 222 of thesecond housing structure 220, and at least a part of the periphery ofthe second rear surface cover may be surrounded by the second housingstructure 220.

In the illustrated embodiment of the disclosure, the first rear surfacecover 240 and the second rear surface cover 250 may have substantially asymmetrical shape with respect to the folding axis (A axis). As anotherexample, the first rear surface cover 240 and the second rear surfacecover 250 may include various different shapes. As another example, thefirst rear surface cover 240 may be integrally formed with the firsthousing structure 210, and the second rear surface cover 250 may beintegrally formed with the second housing structure 220.

In an embodiment of the disclosure, the first rear surface cover 240,the second rear surface cover 250, the first housing structure 210, andthe second housing structure 220 may be coupled to each other, and aspace in which various components (e.g., a printed circuit board, anantenna module, a sensor module, or a battery) of the electronic device200 can be arranged may be provided through the coupling structure. Inan embodiment of the disclosure, one or more components may be arrangedon the rear surface of the electronic device 200, or may be visuallyseen through the rear surface. For example, one or more components orsensors may be visually seen through a first rear surface region 241 ofthe first rear surface cover 240. In various embodiments of thedisclosure, the sensors may include a proximity sensor, a rear cameradevice, and/or a flash. In another embodiment of the disclosure, atleast a part of a sub-display 252 (e.g., the second display) may bevisually seen through a second rear surface region 251 of the secondrear surface cover 250. In another embodiment of the disclosure, theelectronic device 200 may include a speaker module 253 disposed throughat least a partial region of the second rear surface cover 250.

The first display 230 may be disposed in a space formed by the first andsecond housing structures 210 and 220. For example, the first display230 may be stably placed in the recess 201 formed by the first andsecond housing structures 210 and 220, and may be disposed tosubstantially cover most parts of the front surface of the electronicdevice 200. Therefore, the front surface of the electronic device 200may include the first display 230, and a partial region (e.g., aperiphery region) of the first housing structure 210 and a partialregion (e.g., a periphery region) of the second housing structure 220,which are adjacent to the first display 230. In an embodiment of thedisclosure, the rear surface of the electronic device 200 may includethe first rear surface cover 240, a partial region (e.g., a peripheryregion) of the first housing structure 210, which is adjacent to thefirst rear surface cover 240, the second rear surface cover 250, and apartial region (e.g., a periphery region) of the second housingstructure 220, which is adjacent to the second rear surface cover 250.

In an embodiment of the disclosure, the first display 230 may mean adisplay, at least a partial region of which is transformable into a flatsurface or a curved surface. In an embodiment of the disclosure, thefirst display 230 may include a folding region 231 c, a first region 231a disposed at one side (e.g., the right side region of the foldingregion 231 c) with respect to the folding region 231 c, and a secondregion 231 b disposed at the other side (e.g., the left side region ofthe folding region 231 c). For example, the first region 231 a isdisposed on the first surface 211 of the first housing structure 210,and the second region 231 b may be disposed on the third surface 221 ofthe second housing structure 220. In an embodiment of the disclosure,the region division of the first display 230 corresponds to an example,and the first display 230 may be divided into multiple (e.g., four ormore, or two) regions according to a structure or a function. Forexample, in the embodiment illustrated in FIG. 2A, the region of thefirst display 230 may be divided by the folding region 231 c or thefolding axis (A axis) extending in parallel with y axis. However, inanother embodiment of the disclosure, the region of the first display230 may be divided with reference to another folding region (e.g., afolding region parallel with x axis) or another folding axis (e.g., afolding region (e.g., a folding axis parallel with x axis). The displayregion division described above merely corresponds to a physicaldivision by the pair of housing structures 210 and 220 and the hingestructure (e.g., the hinge structure 265 in FIG. 2A). Practically, thefirst display 230 may display a single entire screen through the pair ofhousing structures 210 and 220 and the hinge structure (e.g., the hingestructure 265 in FIG. 2A). In an embodiment of the disclosure, the firstregion 231 a may include a notch region obtained through cuttingaccording to the existence of the sensor region 231 d unlike the secondregion 231 b. In an embodiment of the disclosure, the first region 231 aand the second region 231 b may have a symmetrical part and anasymmetrical part.

Referring to FIG. 2B, the hinge cover 265 may be disposed between thefirst housing structure 210 and the second housing structure 220 tocover an internal component (e.g., the hinge structure 265 in FIG. 2A).In an embodiment of the disclosure, the hinge cover 265 may be hidden bya part of the first housing structure 210 and the second housingstructure 220 or may be seen from the outside according to an operationstate (e.g., an open state (a flat state) or a folded state) of theelectronic device 200.

Hereinafter, the operations of the first housing structure 210 and thesecond housing structure 220 and each of the regions of the firstdisplay 230 will be described according to an operation state (e.g., anopen state (a flat state) or a folded state) of the electronic device200.

In an embodiment of the disclosure, if the electronic device 200 is inan open state (a flat state), the first housing structure 210 and thesecond housing structure 220 may make a straight angle (e.g., 180degrees). In the open state (e.g., a first designated state), the firstregion (e.g., the region 231 a in FIG. 2A) and the second region (e.g.,the region 231 b in FIG. 2A) of the display may be arranged in the samedirection. In addition, if the electronic device is in the open state,the folding region (e.g., the region 231 c in FIG. 2A) may be disposedon the same plane as that for the first region 231 a and the secondregion 231 b. As another example, if the electronic device 200 is in anopen state (a flat state), the first housing structure 210 and thesecond housing structure 220 may be, for example, folded in the reversedirection such that the angle made by the second housing structure 220with respect to the first housing structure 210 is changed to be 360degrees through rotation to allow the second surface 212 to face thefourth surface 222.

In an embodiment of the disclosure, if the electronic device 200 is inan intermediate state (e.g., a second designated state), the firsthousing structure 210 and the second housing structure 220 may bearranged to make a predetermined angle (e.g., the angle between 10 to 90degrees) therebetween. The first region (e.g., the region 231 a in FIG.2A) and the second region (e.g., the region 231 b in FIG. 2A) of thefirst display 230 may make an angle larger than that in a folded stateand smaller than that in an open state. At least a part of the foldedregion (e.g., the region 231 c in FIG. 2A) may have a curved surfacehaving a predetermined curvature, and the curvature may be smaller thanthat in a folded state.

In an embodiment of the disclosure, when the electronic device 200 is ina folded state (e.g., a third designated state), the first housingstructure 210 and the second housing structure 220 may be arranged toface each other. The first region (e.g., the region 231 a in FIG. 2A)and the second region (e.g., the region 231 b in FIG. 2A) of the firstdisplay 230 may make an acute angle (e.g., the angle between 0 and 10degrees), and may be arranged to face each other. At least a part of thefolded region (e.g., the region 231 c in FIG. 2A) may have a curvedsurface having a predetermined curvature.

FIG. 3A is a perspective view of a front surface of a mobile electronicdevice according to an embodiment of the disclosure.

FIG. 3B is a perspective view of a rear surface of the electronic deviceillustrated in FIG. 3A according to an embodiment of the disclosure.

Referring to FIGS. 3A and 3B, an electronic device 300 (e.g., theelectronic device 101 in FIG. 1 ) according to an embodiment may includea housing 310 including a first surface (or front surface) 310A, asecond surface (or rear surface) 310B, and a side surface 310Csurrounding a space between the first surface 310A and the secondsurface 310B. In another embodiment (not illustrated), the housing mayindicate a structure configuring a part of the first surface 310A, thesecond surface 310B, and the side surface 310C illustrated in FIG. 1 .According to an embodiment of the disclosure, the first surface 310A maybe configured by a front surface plate 302 (e.g., a glass plateincluding various coating layers, or a polymer plate), at least a partof which is substantially transparent. The second surface 310B may beconfigured by a rear surface plate 311 that is substantially opaque. Therear surface plate 311 may be formed of, for example, coated or coloredglass, ceramic, polymer, metal (e.g., aluminum, stainless steel (STS),or magnesium), or a combination of at least two of the materials. Theside surface 310C may be configured by a side surface bezel structure(or a “side surface member”) 318 that is coupled to the front surfaceplate 302 and the rear surface plate 311 and includes metal and/orpolymer. In an embodiment of the disclosure, the rear surface plate 311and the side surface bezel structure 318 may be integrally configured,and may include an identical material (e.g., a metal material, such asaluminum).

In the illustrated embodiment of the disclosure, the front surface plate302 may include two first regions 310D seamlessly extending from thefirst surface 310A to be bent toward the rear surface plate 311 on bothlong edges of the front surface plate 302. In the illustrated embodiment(see FIG. 3B), the rear surface plate 311 may include two second regions310E seamlessly extending from the second surface 310B to be bent towardthe front surface plate 302 on both long edges of the rear surfaceplate. In an embodiment of the disclosure, the front surface plate 302(or the rear surface plate 311) may include only one of the firstregions 310D (or the second regions 310E). In another embodiment of thedisclosure, a part of the first regions 310D or the second regions 310Emay not be included. In the embodiments of the disclosure, when viewedin the side surface of the electronic device 300, the side surface bezelstructure 318 may have a first thickness (or width) in the side surfaceat which the first regions 310D or the second regions 310E are notincluded, and may have a second thickness smaller than the firstthickness in the side surface at which the first regions 310D or thesecond regions 310E are included.

According to an embodiment of the disclosure, the electronic device 300(e.g., the electronic device 101 in FIG. 1 ) may include at least one ofa display 301, audio modules 303, 307, and 314, sensor modules 304, 316,and 119, camera modules 305, 312, and 313, a key input device 317, alight emitting element 306, a pen input device 320, and connector holes308 and 309. In an embodiment of the disclosure, the electronic device300 (e.g., the electronic device 101 in FIG. 1 ) may omit at least one(e.g., the key input device 317 or the light emitting element 306) ofthe elements or additionally include another element.

The display 301 may be, for example, exposed through a considerableportion of the front surface plate 302. In an embodiment of thedisclosure, at least a part of the display 301 may be exposed throughthe front plate 302 configuring the first surface 310A and the firstregions 310D positioned at the side surface 310C. In an embodiment ofthe disclosure, an edge of the display 301 may be configured to besubstantially identical to the shape of an outer portion of the frontsurface plate 302 adjacent to the edge. In another embodiment (notillustrated), in order to extend the area by which the display 301 isexposed, an interval between an outer portion of the display 301 and anouter portion of the front surface plate 302 may be configured to besubstantially identical to each other.

In another embodiment (not illustrated), a recess or an opening may bedisposed at a part of a screen display region of the display 301, and atleast one of the audio module 314, the sensor module 304, the cameramodule 305, and the light emitting element 306 may be included to bealigned with the recess or the opening. In another embodiment (notillustrated), at least one of the audio module 314, the sensor module304, the camera module 305, a fingerprint sensor 316, and the lightemitting element 306 may be included on a rear surface of the screendisplay region of the display 301. In another embodiment (notillustrated), the display 301 may be coupled to or disposed to beadjacent to a touch detection circuit, a pressure sensor capable ofmeasuring the strength (pressure) of a touch, and/or a digitizer thatdetects a stylus pen using a magnetic field. In an embodiment of thedisclosure, at least a part of the sensor module 304 and 319 and/or atleast a part of the key input device 317 may be disposed in the firstregions 310D and/or the second regions 310E.

The audio modules 303, 307, and 314 may include a microphone hole 303and speaker holes 307 and 314. A microphone configured to obtainexternal sound may be disposed in the microphone hole 303, and in anembodiment of the disclosure, a plurality of microphones may be arrangedtherein to detect the direction of sound. The speaker holes 307 and 314may include the external speaker hole 307 and the call receiver hole314. In an embodiment of the disclosure, the speaker holes 307 and 314and the microphone hole 303 may be implemented as a single hole, or aspeaker may be included without the speaker holes 307 and 314 (e.g., apiezoelectric speaker).

The sensor modules 304, 316, and 319 may generate an electrical signalor a data value corresponding to an internal operation state or anexternal environment state of the electronic device 300 (e.g., theelectronic device 101 in FIG. 1 ). The sensor modules 304, 316, and 319may include, for example, a first sensor module 304 (e.g., a proximitysensor) and/or a second sensor module (not illustrated) (e.g., afingerprint sensor) disposed on the first surface 310A of the housing310, and/or a third sensor module 319 (e.g., a heart rate monitor (HRM)sensor) and/or a fourth sensor module 316 (e.g., a fingerprint sensor)disposed on the second surface 310B of the housing 310. The fingerprintsensor may be disposed on the second surface 310B of the housing 310 aswell as the first surface 310A (e.g., the display 301). The electronicdevice 300 (e.g., the electronic device 101 in FIG. 1 ) may furtherinclude a sensor module which is not illustrated, for example, at leastone of a gesture sensor, a gyro sensor, an atmospheric pressure sensor,a magnetic sensor, an acceleration sensor, a grip sensor, a colorsensor, an infrared (IR) sensor, a biometric sensor, a temperaturesensor, a humidity sensor, or an illuminance sensor 304.

The camera modules 305, 312, and 313 may include a first camera device305 disposed on the first surface 310A of the electronic device 300(e.g., the electronic device 101 in FIG. 1 ) and a second camera device312 and/or a flash 313 disposed on the second surface 310B. The cameradevices 305 and 312 may include one or a plurality of lenses, an imagesensor, and/or an image signal processor. The flash 313 may include, forexample, a light emitting diode or a xenon lamp. In an embodiment of thedisclosure, two or more lenses (an infrared camera, and wide-angle andtelephoto lenses) and image sensors may be arranged on one surface ofthe electronic device 300 (e.g., the electronic device 101 in FIG. 1 ).

The key input device 317 may be disposed on the side surface 310C of thehousing 310. In another embodiment of the disclosure, the electronicdevice 300 may not include a part or the entirety of key input device317, and a key input device 317 that is not included may be implementedin a different type, such as a soft key on the display 301. In anembodiment of the disclosure, the key input device may include thesensor module 316 disposed on the second surface 310B of the housing310.

The light emitting element 306 may be, for example, disposed on thefirst surface 310A of the housing 310. The light emitting element 306may provide, for example, state information of the electronic device 300(e.g., the electronic device 101 in FIG. 1 ) by using light. In anotherembodiment of the disclosure, the light emitting element 306 mayprovide, for example, a light source interworking with an operation ofthe camera module 305. The light emitting element 306 may include alight emitting diode (LED), an IR LED, and a xenon lamp, for example.

The connector holes 308 and 309 may include a first connector hole 308capable of receiving a connector (e.g., a USB connector) configured totransmit or receive power and/or data to or from an external electronicdevice, and/or a second connector hole (e.g., an earphone jack) 309capable of receiving a connector configured to transmit or receive anaudio signal to or from an external electronic device.

The pen input device (320 (e.g., a stylus pen) may be guided andinserted inside the housing 310 through a hole 321 formed on the sidesurface of the housing 310, or may be detachably attached to thehousing, and may include a button making attachment and detachment easy.A separate resonance circuit may be embedded in the pen input device320, so that the pen input device may be linked to an electromagneticinduction panel (e.g., a digitizer) included in the electronic device300. The pen input device 320 may employ an electro-magnetic resonance(EMR) scheme, an active electrical stylus (AES) scheme, and an electriccoupled resonance (ECR) scheme.

FIG. 4 illustrates a software structure 400 of an electronic device(e.g., the electronic device 101 in FIG. 1 , the electronic device 200in FIG. 2A, or the electronic device 300 in FIG. 3A) according to anembodiment of the disclosure.

According to various embodiments of the disclosure, at least a part ofthe illustrated configuration may be changed according to a platformincluded in the electronic device (e.g., the electronic device 101 inFIG. 1 , the electronic device 200 in FIG. 2A, or the electronic device300 in FIG. 3A).

Referring to FIG. 4 , an application layer 410 may include at least oneapplication 411 (e.g., the application 146 in FIG. 1 ) and a system userinterface (UI) 415 which are stored in a memory (e.g., the memory 130 inFIG. 1 ) and can be executed by a processor. The application 411 mayinclude an Internet browser, a video application, and a game, and thetype of the application may not be limited thereto. The system UI 415may indicate an application configuring various graphical user interface(GUI) screens implemented on a system of the electronic device, such asa notification bar, or a quick view.

A framework layer 420 may provide various functions to the application411 so that a function or information provided from at least oneresource of the electronic device (e.g., the electronic device 101 inFIG. 1 , the electronic device 200 in FIG. 2A, or the electronic device300 in FIG. 3A) can be used by the application 411.

The framework layer 420 may include an activity manager 412, a windowmanager 422, a view system 423, a power manager 424, an input manager425, a display manager 426, and a sensor manager 427.

The activity manager 412 may control a life cycle and an activity stackof an application.

The window manager 422 may manage one or more GUI resources that areused in a screen of the electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A).

The view system 423 may be a set of extensible views used to create anapplication user interface.

The power manager 424 may manage the capacity, temperature, or power ofa battery of the electronic device (e.g., the electronic device 101 inFIG. 1 , the electronic device 200 in FIG. 2A, or the electronic device300 in FIG. 3A), and may use corresponding information among the managedcapacity, temperature, or power to determine or provide relevantinformation required for an operation of the electronic device (e.g.,the electronic device 101 in FIG. 1 , the electronic device 200 in FIG.2A, or the electronic device 300 in FIG. 3A).

The input manager 425 may be a module (a key layout, etc.) configured toprovide information of an input device (the input device 150 in FIG. 1 )provided in the electronic device (e.g., the electronic device 101 inFIG. 1 , the electronic device 200 in FIG. 2A, or the electronic device300 in FIG. 3A).

The display manager 426 may manage a lifecycle (connection, attributechange/removal) of a display device (e.g., the display device 160 inFIG. 1 ), and may manage hardware (H/W) display mapping to output ascreen GUI element (window). The display manager may function to changean output display device (e.g., the display device 160 in FIG. 1 ) by asystem event, such as a folding state change.

The sensor manager 427 may control an operation of a sensor module (thesensor module 176 in FIG. 1 ), based on usability, such as anapplication of a sensor.

A hardware abstraction layer (HAL) 430 may indicate an abstracted layerbetween software of the electronic device and a plurality of hardwaremodules included in a hardware layer. The hardware abstraction layer 430may include an input dispatcher 431, an event hub 432 that provides aninterface that standardizes an event occurring in a sensor, or a surfaceflinger 433. The input dispatcher 431 may perform a function ofdetermining an application 411 to which an occurred event is to beprovided. The surface flinger 433 may perform a function of providing anexecution screen to be displayed in a display device (e.g., the displaydevice 160 in FIG. 1 ) among execution screens generated in severalapplications 411. When a configuration of a display (e.g., the displaydevice 160 in FIG. 1 ) is changed, the surface flinger may request theapplication 411 to process a change of resolution and density accordingto the changed configuration of the display (e.g., the display device160 in FIG. 1 ). The event hub 432 may be an interface module in whichevents occurring in a touch module and a sensor module (the sensormodule 176 in FIG. 1 ) are standardized. The input dispatcher 431 may bea module which transfers an input event to an input target windowprocess.

A kernel driver layer 440 may include various drivers which controlvarious hardware modules included in the electronic device (e.g., theelectronic device 101 in FIG. 1 , the electronic device 200 in FIG. 2A,or the electronic device 300 in FIG. 3A). The kernel driver layer 440may include a touch driver 441 including an interface module whichcontrols a touch controller 451, and a sensor driver 442 including aninterface module which controls a sensor controller 452 connected to asensor. The touch driver 441 may be an interface module which controlsthe touch controller 451. The sensor driver 442 may be an interfacemodule which controls the sensor controller 452.

A hardware layer 450 may include the touch controller 451 and the sensorcontroller 452.

The touch controller 451 may be a module which controls a touch circuitconfigured on a display (e.g., the display device 160 in FIG. 1 ) toreceive a touch input.

The sensor controller 452 may include a hall sensor which detects afolding state of a foldable electronic device (e.g., the electronicdevice 200 in FIGS. 2A and 2B).

FIG. 5 is a block diagram illustrating a drawing engine 500 of anelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to an embodiment of the disclosure.

Referring to FIG. 5 , the electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) may designate a partial region of a memory (thememory 130 in FIG. 1 ) to be surfaces 521, 522, and 523 for recording anexecution state of applications 511 and 512 (e.g., the application 411in FIG. 4 ).

A surface flinger 530 (e.g., the surface flinger 433 in FIG. 4 ) maydetermine whether to display, on a screen, an execution screen of anapplication recorded in the surfaces 521, 522, and 523, and may requestthe applications 511 and 512 to process a change of resolution anddensity when the configuration of a display is changed.

An execution screen corresponding to display resolution and densitycreated by each of the applications 511 and 512 may be stored in a framebuffer 540.

The surface flinger 530 may store, in the frame buffer 540, an executionscreen corresponding to display resolution and density created by eachof the applications 511 and 512 and recorded in the surfaces 521, 522,and 523.

FIG. 6 is a flowchart illustrating a method for operating capturing byan electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to an embodiment of the disclosure.

Referring to FIG. 6 , an electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may capture aprocess screen displayed on a display (e.g., the display device 160 inFIG. 1 , the display 230 in FIG. 2A, or the display 301 in FIG. 3A)under control of a processor (e.g., the processor 120 in FIG. 1 ), inoperation 601.

According to various embodiments of the disclosure, the displayedprocess screen may be a screen in which image or video information isdisplayed in a window and/or layout activated on the display (e.g., thedisplay device 160 in FIG. 1 , the display 230 in FIG. 2A, or thedisplay 301 in FIG. 3A).

According to various embodiments of the disclosure, the displayedprocess screen may include a user interface of a running application.The application may correspond to a running application stored in asingle window frame buffer screen or multiple window frame buffers.According to various embodiments of the disclosure, the capturingoperation may include an operation of obtaining and/or generating astill picture image of a screen displayed on the display (e.g., thedisplay device 160 in FIG. 1 , the display 230 in FIG. 2A, or thedisplay 301 in FIG. 3A).

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may request rendering informationfrom the display (e.g., the display device 160 in FIG. 1 , the display230 in FIG. 2A, or the display 301 in FIG. 3A) or the application inorder to obtain a still picture image under control of the processor(e.g., the processor 120 in FIG. 1 ), in operation 601. The renderinginformation may be required for the display (e.g., the display device160 in FIG. 1 , the display 230 in FIG. 2A, or the display 301 in FIG.3A) to display a graphic object. For example, the electronic device(e.g., the electronic device 101 in FIG. 1 , the electronic device 200in FIG. 2A, or the electronic device 300 in FIG. 3A) may request andobtain rendering information from a driver circuit of the display (e.g.,the display device 160 in FIG. 1 , the display 230 in FIG. 2A, or thedisplay 301 in FIG. 3A) to create a still picture image under control ofthe processor (e.g., the processor 120 in FIG. 1 ). The electronicdevice (e.g., the electronic device 101 in FIG. 1 , the electronicdevice 200 in FIG. 2A, or the electronic device 300 in FIG. 3A) mayrequest and obtain rendering information from the application to createa still picture image under control of the processor (e.g., theprocessor 120 in FIG. 1 ).

According to various embodiments of the disclosure, the electronicdevice (e.g., the electronic device 101 in FIG. 1 , the electronicdevice 200 in FIG. 2A, or the electronic device 300 in FIG. 3A)according to various embodiments may obtain an image including a stillpicture of an image displayed on the display (e.g., the display device160 in FIG. 1 , the display 230 in FIG. 2A, or the display 301 in FIG.3A), based on the obtained rendering information under control of theprocessor (e.g., the processor 120 in FIG. 1 ), in operation 601.

According to various embodiments of the disclosure, a command to capturea screen of the electronic device (e.g., the electronic device 101 inFIG. 1 , the electronic device 200 in FIG. 2A, or the electronic device300 in FIG. 3A) may include a command to select an object region tocapture a screen and/or a command to capture the entire screen.

According to various embodiments of the disclosure, a command to capturea screen of the electronic device (e.g., the electronic device 101 inFIG. 1 , the electronic device 200 in FIG. 2A, or the electronic device300 in FIG. 3A) may be performed, for example, by a key input, a touchinput, a voice input, and a stylus input.

According to various embodiments of the disclosure, when an input by acombination of multiple button keys (e.g., the input device 150 in FIG.1 , and the key input device 317 in FIGS. 3A and 3B) is received, theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) may capture a displayed screen.

According to various embodiments of the disclosure, when a particulargesture by a touch input is received, the electronic device (e.g., theelectronic device 101 in FIG. 1 , the electronic device 200 in FIG. 2A,or the electronic device 300 in FIG. 3A) may capture a displayed screen.For example, the particular gesture by a touch input may be a gesture inwhich a user swipes the display (or a touch screen) with the edge orpalm of his/her hand in a particular direction.

According to various embodiments of the disclosure, when a voice inputis received, the electronic device (e.g., the electronic device 101 inFIG. 1 , the electronic device 200 in FIG. 2A, or the electronic device300 in FIG. 3A) may capture a displayed screen. For example, the voiceinput may be a user voice including a particular word and/or aninstruction. The electronic device (e.g., the electronic device 101 inFIG. 1 , the electronic device 200 in FIG. 2A, or the electronic device300 in FIG. 3A) may receive and recognize the voice input through avoice recognition platform (e.g., Bixby).

According to various embodiments of the disclosure, when a stylus inputis received, the electronic device (e.g., the electronic device 101 inFIG. 1 , the electronic device 200 in FIG. 2A, or the electronic device300 in FIG. 3A) may capture a displayed screen.

According to various embodiments of the disclosure, when the electronicdevice (e.g., the electronic device 101 in FIG. 1 , the electronicdevice 200 in FIG. 2A, or the electronic device 300 in FIG. 3A) receivesan input of selecting an object region according to a touch input of astylus pen, the electronic device may determine the input as a commandto select an object region to capture a screen, under control of theprocessor (e.g., the processor 120 in FIG. 1 ).

According to various embodiments of the disclosure, when the electronicdevice (e.g., the electronic device 101 in FIG. 1 , the electronicdevice 200 in FIG. 2A, or the electronic device 300 in FIG. 3A) receivesan input of executing an object region selection function and selectingan object region according to a touch input (e.g., a touch by a styluspen or a hand), the electronic device may determine the input as acommand to select an object region to capture a screen, under control ofthe processor (e.g., the processor 120 in FIG. 1 ).

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may extract additional informationaccording to a displayed process under control of the processor (e.g.,the processor 120 in FIG. 1 ), in operation 603.

The operation of extracting the additional information according to thedisplayed process according to various embodiments may be an operationof providing a screen and/or function allowing the captured screen to beedited, under control of the processor (e.g., the processor 120 in FIG.1 ). For example, the function for editing the captured screen mayinclude Crop image, Reduce/Enlarge image, Rotate image, image effect,image color temperature, image color correction, or the like. An icon,an image, or a text corresponding to the function for editing thecaptured screen may be provided as a user interface in a tool bar type.The screen and/or function allowing the captured screen to be edited maycorrespond to a screenshot toolbar.

The operation of extracting the additional information according to thedisplayed process according to various embodiments may be an operationin which the electronic device (e.g., the electronic device 101 in FIG.1 , the electronic device 200 in FIG. 2A, or the electronic device 300in FIG. 3A) extracts the additional information from a frame bufferunder control of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 603.

The operation of extracting the additional information according to thedisplayed process according to various embodiments may be an operationin which the electronic device (e.g., the electronic device 101 in FIG.1 , the electronic device 200 in FIG. 2A, or the electronic device 300in FIG. 3A) extracts the additional information from the applicationunder control of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 603. For example, if the application is an Internet browser,the operation of extracting the additional information from theapplication may be an operation of parsing hypertext markup language(HTML) information.

The operation of extracting the additional information according to thedisplayed process according to various embodiments may be an operationin which the electronic device (e.g., the electronic device 101 in FIG.1 , the electronic device 200 in FIG. 2A, or the electronic device 300in FIG. 3A) extracts the additional information from the renderinginformation obtained from the application or the display (e.g., thedisplay device 160 in FIG. 1 , the display 230 in FIG. 2A, or thedisplay 301 in FIG. 3A) under control of a processor (e.g., theprocessor 120 in FIG. 1 ), in operation 603.

The operation of extracting the additional information according to thedisplayed process according to various embodiments may be an operationof extracting a region and/or a block region of the still picture of thedisplayed process, under control of the processor (e.g., the processor120 in FIG. 1 ), in operation 603.

The operation of extracting the additional information according to thedisplayed process according to various embodiments may be an operationof segmenting the still picture of the displayed process into regionsand/or block regions under control of the processor (e.g., the processor120 in FIG. 1 ), in operation 603.

In the electronic device (e.g., the electronic device 101 in FIG. 1 ,the electronic device 200 in FIG. 2A, or the electronic device 300 inFIG. 3A) according to various embodiments of the disclosure, theoperation of extracting a region and/or a block region of the stillpicture of the displayed process, under control of the processor (e.g.,the processor 120 in FIG. 1 ), in operation 603, may be an operation ofextracting an image region and/or a text region in the still picture inunits of blocks.

In the electronic device (e.g., the electronic device 101 in FIG. 1 ,the electronic device 200 in FIG. 2A, or the electronic device 300 inFIG. 3A) according to various embodiments of the disclosure, theoperation of segmenting the still picture of the displayed process intoregions and/or block regions under control of the processor (e.g., theprocessor 120 in FIG. 1 ), in operation 603, may be an operation ofsegmenting an image region and/or a text region in the still picture inunits of blocks.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may modify the captured screenunder control of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 605.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may modify an object screencaptured in the frame buffer and/or the application under control of theprocessor (e.g., the processor 120 in FIG. 1 ), in operation 605.

The operation of modifying the captured screen according to variousembodiments may be an operation of revising the captured screen by auser input and/or a predetermined image editing process.

For example, in the operation of modifying the captured screen, a “Cropimage” operation may be performed by a user input. For example, in theoperation of modifying the captured screen, a “Crop image” operation maybe performed by the predetermined image editing process.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may store, as a capture image,extracted object information and the captured screen under control ofthe processor (e.g., the processor 120 in FIG. 1 ), in operation 607.According to various embodiments of the disclosure, the operation ofstoring the captured screen as a capture image may also include anoperation of storing a screen in which an image is not modified by auser.

FIG. 7 is a flowchart illustrating an operation of capturing a displayedprocess screen by an electronic device (e.g., the electronic device 101in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to an embodiment of the disclosure.

Referring to FIG. 7 , an electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may receive acommand to capture a displayed screen under control of a processor(e.g., the processor 120 in FIG. 1 ), in operation 701.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may determine whether the receivedcommand is a command to select an object region to capture a screenunder control of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 703.

If it is determined that the received command is a command to select anobject region to capture a screen, the electronic device (e.g., theelectronic device 101 in FIG. 1 , the electronic device 200 in FIG. 2A,or the electronic device 300 in FIG. 3A) according to variousembodiments may enter into operation 705, under control of the processor(e.g., the processor 120 in FIG. 1 ), in operation 703.

If it is determined that the received command is not a command to selectan object region to capture a screen, the electronic device (e.g., theelectronic device 101 in FIG. 1 , the electronic device 200 in FIG. 2A,or the electronic device 300 in FIG. 3A) according to variousembodiments may determine that the received command is a command tocapture the entire screen, and may enter into operation 707, undercontrol of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 703.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may select an object regionselected according to a user input under control of the processor (e.g.,the processor 120 in FIG. 1 ), in operation 705.

If the received command is a command to select an object region tocapture a screen, the electronic device (e.g., the electronic device 101in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may capture anobject region screen selected according to a user input under control ofthe processor (e.g., the processor 120 in FIG. 1 ), in operation 707.

If the received command is a command to capture the entire screen, theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may capture the entire screen undercontrol of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 707.

FIG. 8 is a flowchart illustrating an operation of extracting additionalinformation according to a displayed process in an electronic device(e.g., the electronic device 101 in FIG. 1 , the electronic device 200in FIG. 2A, or the electronic device 300 in FIG. 3A) according to anembodiment of the disclosure.

Referring to FIG. 8 , an electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may extractobject region information from a frame buffer and/or a runningapplication under control of a processor (e.g., the processor 120 inFIG. 1 ), in operation 801.

According to various embodiments of the disclosure, the object regioninformation may be information relating to an image region or a textregion, window information, and/or layout information in the framebuffer and/or the running application.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may obtain screen configurationinformation, based on the object region information under control of theprocessor (e.g., the processor 120 in FIG. 1 ), in operation 803.

According to various embodiments of the disclosure, the screenconfiguration information may be information relating to the positionand/or the size of an object region in the frame buffer and/or therunning application.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may display the screenconfiguration information and/or display image data corresponding to theobject region information on a display (e.g., the display device 160 inFIG. 1 , the display 230 in FIG. 2A, or the display 301 in FIG. 3A)under control of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 805.

According to various embodiments of the disclosure, the operation ofdisplaying the display image data corresponding to the object regioninformation may be an operation of displaying information for screenediting, screen configuration information, and/or a user interface.

FIG. 9 is a flowchart illustrating a method for operating capturing byan electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to an embodiment of the disclosure.

Referring to FIG. 9 , an electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may capture aprocess screen displayed on a display (e.g., the display device 160 inFIG. 1 , the display 230 in FIG. 2A, or the display 301 in FIG. 3A)under control of a processor (e.g., the processor 120 in FIG. 1 ), inoperation 901.

According to various embodiments of the disclosure, the displayedprocess screen may be a screen in which image or video information isdisplayed in a window and/or layout activated on the display (e.g., thedisplay device 160 in FIG. 1 , the display 230 in FIG. 2A, or thedisplay 301 in FIG. 3A).

According to various embodiments of the disclosure, the displayedprocess screen may include a user interface of a running application.The application may correspond to a running application stored in asingle window frame buffer screen or multiple window frame buffers.According to various embodiments of the disclosure, the capturingoperation may include an operation of obtaining and/or generating astill picture image of a screen displayed on the display (e.g., thedisplay device 160 in FIG. 1 , the display 230 in FIG. 2A, or thedisplay 301 in FIG. 3A).

According to various embodiments of the disclosure, the electronicdevice (e.g., the electronic device 101 in FIG. 1 , the electronicdevice 200 in FIG. 2A, or the electronic device 300 in FIG. 3A) mayobtain an image including a still picture of an image displayed on thedisplay (e.g., the display device 160 in FIG. 1 , the display 230 inFIG. 2A, or the display 301 in FIG. 3A), based on obtained renderinginformation under control of the processor (e.g., the processor 120 inFIG. 1 ), in operation 901.

According to various embodiments of the disclosure, a command to capturea screen of the electronic device (e.g., the electronic device 101 inFIG. 1 , the electronic device 200 in FIG. 2A, or the electronic device300 in FIG. 3A) may include a command to select an object region tocapture a screen and/or a command to capture the entire screen.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may extract additional informationaccording to a displayed process under control of the processor (e.g.,the processor 120 in FIG. 1 ), in operation 903.

The operation of extracting the additional information according to thedisplayed process according to various embodiments may be an operationof providing a screen and/or function allowing the captured screen to beedited, under control of the processor (e.g., the processor 120 in FIG.1 ).

The operation of extracting the additional information according to thedisplayed process according to various embodiments may be an operationin which the electronic device (e.g., the electronic device 101 in FIG.1 , the electronic device 200 in FIG. 2A, or the electronic device 300in FIG. 3A) extracts the additional information from a frame buffer orthe application under control of the processor (e.g., the processor 120in FIG. 1 ), in operation 903.

The operation of extracting the additional information according to thedisplayed process according to various embodiments may be an operationin which the electronic device (e.g., the electronic device 101 in FIG.1 , the electronic device 200 in FIG. 2A, or the electronic device 300in FIG. 3A) extracts the additional information from renderinginformation obtained from the application or the display (e.g., thedisplay device 160 in FIG. 1 , the display 230 in FIG. 2A, or thedisplay 301 in FIG. 3A) under control of a processor (e.g., theprocessor 120 in FIG. 1 ), in operation 903.

In the electronic device (e.g., the electronic device 101 in FIG. 1 ,the electronic device 200 in FIG. 2A, or the electronic device 300 inFIG. 3A) according to various embodiments of the disclosure, theoperation of extracting a region and/or a block region of the stillpicture of the displayed process, under control of the processor (e.g.,the processor 120 in FIG. 1 ), in operation 903, may be an operation ofextracting an image region and/or a text region in the still picture inunits of blocks.

In the electronic device (e.g., the electronic device 101 in FIG. 1 ,the electronic device 200 in FIG. 2A, or the electronic device 300 inFIG. 3A) according to various embodiments of the disclosure, theoperation of segmenting the still picture of the displayed process intoa region and/or a block region under control of the processor (e.g., theprocessor 120 in FIG. 1 ), in operation 903, may be an operation ofsegmenting an image region and/or a text region in the still picture inunits of blocks.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may determine whether a command tomodify the captured screen has been received, under control of theprocessor (e.g., the processor 120 in FIG. 1 ), in operation 905.

According to various embodiments of the disclosure, if an image editingand/or modifying command is selected on a screenshot toolbar including ascreen and/or a function allowing the captured screen to be edited, theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) may determine that a command to modify the captured screen has beenreceived, under control of the processor (e.g., the processor 120 inFIG. 1 ), in operation 905.

If the reception of a command to modify the captured screen fails, theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may enter into operation 921, undercontrol of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 905.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may store, as an image, thecaptured screen created at a capture command time point under control ofthe processor (e.g., the processor 120 in FIG. 1 ), in operation 921.

If a command to modify the captured screen is received, the electronicdevice (e.g., the electronic device 101 in FIG. 1 , the electronicdevice 200 in FIG. 2A, or the electronic device 300 in FIG. 3A)according to various embodiments may enter into operation 907, undercontrol of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 905.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may determine whether a region ofinterest (ROI) exists in the captured screen, under control of theprocessor (e.g., the processor 120 in FIG. 1 ), in operation 907.

According to various embodiments of the disclosure, under control of theprocessor (e.g., the processor 120 in FIG. 1 ), in operation 907, theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) may separate an image region and/or a text region by using regioninformation, block region information, or the like, extracted from thecaptured screen as additional information, and if a particular region isincluded in the captured screen, the electronic device may determine theparticular region as a region of interest (ROI). For example, theparticular region may be an image region. Under control of the processor(e.g., the processor 120 in FIG. 1 ), in operation 907, the electronicdevice (e.g., the electronic device 101 in FIG. 1 , the electronicdevice 200 in FIG. 2A, or the electronic device 300 in FIG. 3A) mayseparate an image region and/or a text region by using regioninformation, block region information, or the like, extracted from thecaptured screen as additional information, and if a particular region isnot included in the captured screen, the electronic device may determinethat there is no region of interest (ROI).

According to various embodiments of the disclosure, under control of theprocessor (e.g., the processor 120 in FIG. 1 ), in operation 907, theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) may separate an image region and/or a text region by using regioninformation, block region information, or the like, extracted from thecaptured screen as additional information, and if the ratio of aparticular region in the capture screen is equal to or larger than apre-configured ratio, the electronic device may determine the particularregion as a region of interest (ROI). For example, the pre-configuredratio may be about 12%. If the ratio of the particular region in thecapture screen is smaller than the pre-configured ratio, the electronicdevice (e.g., the electronic device 101 in FIG. 1 , the electronicdevice 200 in FIG. 2A, or the electronic device 300 in FIG. 3A) maydetermine that there is no region of interest (ROI), under control ofthe processor (e.g., the processor 120 in FIG. 1 ), in operation 907.

Under control of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 907, the electronic device (e.g., the electronic device 101 inFIG. 1 , the electronic device 200 in FIG. 2A, or the electronic device300 in FIG. 3A) according to various embodiments may separate an imageregion and/or a text region by using region information, block regioninformation, or the like, extracted from the captured screen asadditional information, and if the ratio of a plurality of particularregions in the capture screen is equal to or larger than apre-configured ratio, the electronic device may determine the largestregion as a region of interest (ROI). If the ratio of the plurality ofparticular regions in the capture screen is smaller than thepre-configured ratio, the electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) may determine that there is no region of interest(ROI), under control of the processor (e.g., the processor 120 in FIG. 1), in operation 907. For example, if the ratio of a plurality of imageregions in the capture screen is equal to or larger than thepre-configured ratio, the electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) may determine the largest image region among theplurality of image regions as a region of interest (ROI) under controlof the processor (e.g., the processor 120 in FIG. 1 ).

If it is determined that a region of interest (ROI) exists in thecaptured screen, the electronic device (e.g., the electronic device 101in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may enter intooperation 909 under control of the processor (e.g., the processor 120 inFIG. 1 ), in operation 907.

If it is determined that there is no region of interest (ROI) in thecaptured screen, the electronic device (e.g., the electronic device 101in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may enter intooperation 915 under control of the processor (e.g., the processor 120 inFIG. 1 ), in operation 907.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may perform an operation ofsuggesting the region of interest (ROI) under control of the processor(e.g., the processor 120 in FIG. 1 ), in operation 909.

According to various embodiments of the disclosure, the operation ofsuggesting the region of interest (ROI) may be an operation ofdisplaying an image (e.g., a GUI element related to highlight,inversion, a box, and/or an icon) indicating a region of interest (ROI),during a pre-configured time interval. If the pre-configured timeinterval has passed, the image (e.g., a GUI element related tohighlight, inversion, a box, and/or an icon) indicating the region ofinterest (ROI) may disappear. The electronic device (e.g., theelectronic device 101 in FIG. 1 , the electronic device 200 in FIG. 2A,or the electronic device 300 in FIG. 3A) according to variousembodiments may maintain a view layout of the captured screen whiledisplaying an image (e.g., a GUI element related to highlight,inversion, a box, and/or an icon) indicating a region of interest (ROI),during a pre-configured time interval, under control of the processor(e.g., the processor 120 in FIG. 1 ), in operation 909.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may determine whether the region ofinterest (ROI) is selected, under control of the processor (e.g., theprocessor 120 in FIG. 1 ), in operation 911.

According to various embodiments of the disclosure, if a command or aninput of selecting the region of interest (ROI) by a user input isreceived, the electronic device (e.g., the electronic device 101 in FIG.1 , the electronic device 200 in FIG. 2A, or the electronic device 300in FIG. 3A) may determine that the region of interest (ROI) is selected,under control of the processor (e.g., the processor 120 in FIG. 1 ).

According to various embodiments of the disclosure, if it is determinedthat a command or an input of selecting the region of interest (ROI) bya user input is not received, and a region other than the region ofinterest (ROI) is selected, the electronic device (e.g., the electronicdevice 101 in FIG. 1 , the electronic device 200 in FIG. 2A, or theelectronic device 300 in FIG. 3A) may determine that the region ofinterest (ROI) is not selected, under control of the processor (e.g.,the processor 120 in FIG. 1 ).

If it is determined that the region of interest (ROI) is selected, theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may enter into operation 913, undercontrol of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 911.

If it is determined that the region of interest (ROI) is not selected,the electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may enter into operation 915, undercontrol of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 911.

If the region of interest (ROI) is selected, the electronic device(e.g., the electronic device 101 in FIG. 1 , the electronic device 200in FIG. 2A, or the electronic device 300 in FIG. 3A) according tovarious embodiments may display a first edit screen, under control ofthe processor (e.g., the processor 120 in FIG. 1 ), in operation 913.

According to various embodiments of the disclosure, the first editscreen may be an edit screen in which a view layout of the capturedscreen is maintained while an editing tool user interface (e.g., a “Cropimage” user interface) is placed to center on the region of interest(ROI). The region other than the region of interest (ROI) in thecaptured screen may be processed to be darker than the region ofinterest (ROI), or discriminable from the region of interest (ROI), soas to be displayed.

If the region of interest (ROI) is not selected, the electronic device(e.g., the electronic device 101 in FIG. 1 , the electronic device 200in FIG. 2A, or the electronic device 300 in FIG. 3A) according tovarious embodiments may display a second edit screen, under control ofthe processor (e.g., the processor 120 in FIG. 1 ), in operation 915.

According to various embodiments of the disclosure, the second editscreen may be an edit screen in which a view layout of the capturedscreen is maintained while an editing tool user interface (e.g., a “Cropimage” user interface) is placed to center on the entire screen.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may determine whether there is anediting operation according to a user input, under control of theprocessor (e.g., the processor 120 in FIG. 1 ), in operation 917.

According to various embodiments of the disclosure, the editingoperation according to the user input may be an operation in which theediting tool user interface (e.g., a “Crop image” user interface) ismoved by the user input to select a screen desired by the user in thecaptured screen. In the editing operation according to the user input, atime point at which the editing tool user interface (e.g., a “Cropimage” user interface) is moved by the user input and the user input isreleased may be determined as a time point at which the image editingoperation is complete. If the user input is released, the electronicdevice (e.g., the electronic device 101 in FIG. 1 , the electronicdevice 200 in FIG. 2A, or the electronic device 300 in FIG. 3A) maychange the view layout of the captured screen to center on an imageand/or a screen edited according to the user input under control of theprocessor (e.g., the processor 120 in FIG. 1 ).

If there is an editing operation according to a user input, theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may enter into operation 919 undercontrol of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 917.

If there is no editing operation according to a user input, theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may enter into operation 921 undercontrol of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 917.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may store, as an image, a screenedited according to the user input under control of the processor (e.g.,the processor 120 in FIG. 1 ), in operation 919.

FIG. 10 is a flowchart illustrating an operation of modifying a capturedscreen by an electronic device (e.g., the electronic device 101 in FIG.1 , the electronic device 200 in FIG. 2A, or the electronic device 300in FIG. 3A) according to an embodiment of the disclosure.

Referring to FIG. 10 , an electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may determinewhether a region of interest (ROI) exists in a captured screen, undercontrol of a processor (e.g., the processor 120 in FIG. 1 ), inoperation 1001.

According to various embodiments of the disclosure, under control of theprocessor (e.g., the processor 120 in FIG. 1 ), in operation 1001, theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) may separate an image region and/or a text region by using regioninformation, block region information, or the like, extracted from thecaptured screen as additional information, and if a particular region isincluded in the captured screen, the electronic device may determine theparticular region as a region of interest (ROI). For example, theparticular region may be an image region. Under control of the processor(e.g., the processor 120 in FIG. 1 ), in operation 1001, the electronicdevice (e.g., the electronic device 101 in FIG. 1 , the electronicdevice 200 in FIG. 2A, or the electronic device 300 in FIG. 3A) mayseparate an image region and/or a text region by using regioninformation, block region information, or the like, extracted from thecaptured screen as additional information, and if a particular region isnot included in the captured screen, the electronic device may determinethat there is no region of interest (ROI).

According to various embodiments of the disclosure, under control of theprocessor (e.g., the processor 120 in FIG. 1 ), in operation 1001, theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) may separate an image region and/or a text region by using regioninformation, block region information, or the like, extracted from thecaptured screen as additional information, and if the ratio of aparticular region in the capture screen is equal to or larger than apre-configured ratio, the electronic device may determine the particularregion as a region of interest (ROI). For example, the pre-configuredratio may be 12%. If the ratio of the particular region in the capturescreen is smaller than the pre-configured ratio, the electronic device(e.g., the electronic device 101 in FIG. 1 , the electronic device 200in FIG. 2A, or the electronic device 300 in FIG. 3A) may determine thatthere is no region of interest (ROI), under control of the processor(e.g., the processor 120 in FIG. 1 ), in operation 1001.

Under control of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 1001, the electronic device (e.g., the electronic device 101in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may separate animage region and/or a text region by using region information, blockregion information, or the like, extracted from the captured screen asadditional information, and if the ratio of a plurality of particularregions in the capture screen is equal to or larger than apre-configured ratio, the electronic device may determine the largestregion as a region of interest (ROI). If the ratio of the plurality ofparticular regions in the capture screen is smaller than thepre-configured ratio, the electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) may determine that there is no region of interest(ROI), under control of the processor (e.g., the processor 120 in FIG. 1), in operation 1001. For example, if the ratio of a plurality of imageregions in the capture screen is equal to or larger than thepre-configured ratio, the electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) may determine the largest image region among theplurality of image regions as a region of interest (ROI) under controlof the processor (e.g., the processor 120 in FIG. 1 ).

If it is determined that a region of interest (ROI) exists in thecaptured screen, the electronic device (e.g., the electronic device 101in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may enter intooperation 1003 under control of the processor (e.g., the processor 120in FIG. 1 ), in operation 1001.

If it is determined that there is no region of interest (ROI) in thecaptured screen, the electronic device (e.g., the electronic device 101in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may enter intooperation 1009 under control of the processor (e.g., the processor 120in FIG. 1 ), in operation 1001.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may perform an operation ofsuggesting the region of interest (ROI) under control of a processor(e.g., the processor 120 in FIG. 1 ), in operation 1003.

According to various embodiments of the disclosure, the operation ofsuggesting the region of interest (ROI) may be an operation ofdisplaying an image (e.g., a GUI element related to highlight,inversion, a box, and/or an icon) indicating the region of interest(ROI), during a pre-configured time interval. If the pre-configured timeinterval has passed, the image (e.g., a GUI element related tohighlight, inversion, a box, and/or an icon) indicating the region ofinterest (ROI) may disappear. The electronic device (e.g., theelectronic device 101 in FIG. 1 , the electronic device 200 in FIG. 2A,or the electronic device 300 in FIG. 3A) according to variousembodiments may maintain a view layout of the captured screen whiledisplaying an image (e.g., a GUI element related to highlight,inversion, a box, and/or an icon) indicating a region of interest (ROI),during a pre-configured time interval, under control of the processor(e.g., the processor 120 in FIG. 1 ), in operation 1003.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may determine whether the region ofinterest (ROI) is selected, under control of the processor (e.g., theprocessor 120 in FIG. 1 ), in operation 1005.

According to various embodiments of the disclosure, if a command or aninput of selecting the region of interest (ROI) by a user input isreceived, the electronic device (e.g., the electronic device 101 in FIG.1 , the electronic device 200 in FIG. 2A, or the electronic device 300in FIG. 3A) may determine that the region of interest (ROI) is selected,under control of the processor (e.g., the processor 120 in FIG. 1 ).

According to various embodiments of the disclosure, if it is determinedthat a command or an input of selecting the region of interest (ROI) bya user input is not received, and a region other than the region ofinterest (ROI) is selected, the electronic device (e.g., the electronicdevice 101 in FIG. 1 , the electronic device 200 in FIG. 2A, or theelectronic device 300 in FIG. 3A) may determine that the region ofinterest (ROI) is not selected, under control of the processor (e.g.,the processor 120 in FIG. 1 ).

If it is determined that the region of interest (ROI) is selected, theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may enter into operation 1007,under control of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 1005.

If it is determined that the region of interest (ROI) is not selected,the electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may enter into operation 1009,under control of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 1005.

If the region of interest (ROI) is selected, the electronic device(e.g., the electronic device 101 in FIG. 1 , the electronic device 200in FIG. 2A, or the electronic device 300 in FIG. 3A) according tovarious embodiments may display a first edit screen, under control ofthe processor (e.g., the processor 120 in FIG. 1 ), in operation 1007.

According to various embodiments of the disclosure, the first editscreen may be an edit screen in which a view layout of the capturedscreen is maintained while an editing tool user interface (e.g., a “Cropimage” user interface) is placed to center on the region of interest(ROI). The region other than the region of interest (ROI) in thecaptured screen may be processed to be darker than the region ofinterest (ROI), so as to be displayed.

If the region of interest (ROI) is selected, the electronic device(e.g., the electronic device 101 in FIG. 1 , the electronic device 200in FIG. 2A, or the electronic device 300 in FIG. 3A) according tovarious embodiments may display a second edit screen, under control ofthe processor (e.g., the processor 120 in FIG. 1 ), in operation 1009.

According to various embodiments of the disclosure, the second editscreen may be an edit screen in which a view layout of the capturedscreen is maintained while an editing tool user interface (e.g., a “Cropimage” user interface) is placed to center on the entire screen.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may determine whether there is anediting operation according to a user input, under control of theprocessor (e.g., the processor 120 in FIG. 1 ), in operation 1011.

According to various embodiments of the disclosure, the editingoperation according to the user input may be an operation in which theediting tool user interface (e.g., a “Crop image” user interface) ismoved by the user input to select a screen desired by the user in thecaptured screen. In the editing operation according to the user input, atime point at which the editing tool user interface (e.g., a “Cropimage” user interface) is moved by the user input and the user input isreleased may be determined as a time point at which the image editingoperation is complete. If the user input is released, the electronicdevice (e.g., the electronic device 101 in FIG. 1 , the electronicdevice 200 in FIG. 2A, or the electronic device 300 in FIG. 3A) maychange the view layout of the captured screen to center on an imageand/or a screen edited according to the user input under control of theprocessor (e.g., the processor 120 in FIG. 1 ).

If there is an editing operation according to a user input, theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may enter into operation 1013 undercontrol of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 1011.

If there is no editing operation according to a user input, theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may enter into operation 1015 undercontrol of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 1011.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may store, as an image, a screenedited according to the user input under control of the processor (e.g.,the processor 120 in FIG. 1 ), in operation 1013.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may store, as an image, thecaptured screen created at a capture command time point under control ofthe processor (e.g., the processor 120 in FIG. 1 ), in operation 1015.

FIG. 11 is a flowchart illustrating an operation of capturing adisplayed process screen by an electronic device (e.g., the electronicdevice 101 in FIG. 1 , the electronic device 200 in FIG. 2A, or theelectronic device 300 in FIG. 3A) according to an embodiment of thedisclosure.

Referring to FIG. 11 , an electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may receive acommand to capture a displayed screen under control of a processor(e.g., the processor 120 in FIG. 1 ), in operation 1101.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may determine whether the receivedcommand is a command to select an object region to capture a screenunder control of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 1103.

If it is determined that the received command is a command to select anobject region to capture a screen, the electronic device (e.g., theelectronic device 101 in FIG. 1 , the electronic device 200 in FIG. 2A,or the electronic device 300 in FIG. 3A) according to variousembodiments may enter into operation 1105, under control of theprocessor (e.g., the processor 120 in FIG. 1 ), in operation 1103.

If it is determined that the received command is not a command to selectan object region to capture a screen, the electronic device (e.g., theelectronic device 101 in FIG. 1 , the electronic device 200 in FIG. 2A,or the electronic device 300 in FIG. 3A) according to variousembodiments may determine that the received command is a command tocapture the entire screen, and may enter into operation 1113, undercontrol of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 1103.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may extract additional informationaccording to a displayed process under control of the processor (e.g.,the processor 120 in FIG. 1 ), in operation 1105.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may determine whether a region ofinterest (ROI) exists in a captured screen, under control of theprocessor (e.g., the processor 120 in FIG. 1 ), in operation 1107.

If it is determines that a region of interest (ROI) exists in thecaptured screen, the electronic device (e.g., the electronic device 101in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may enter intooperation 1109 under control of the processor (e.g., the processor 120in FIG. 1 ), in operation 1107.

If it is determined that there is no region of interest (ROI) in thecaptured screen, the electronic device (e.g., the electronic device 101in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may enter intooperation 1111 under control of the processor (e.g., the processor 120in FIG. 1 ), in operation 1107.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may focus the region of interest(ROI) under control of a processor (e.g., the processor 120 in FIG. 1 ),in operation 1109.

According to various embodiments of the disclosure, the operation offocusing the region of interest (ROI) may correspond to a view layout inwhich a region around the region of interest (ROI) is processed to bebrightened, and the region other than the region of interest (ROI) isprocessed to be darkened.

According to various embodiments of the disclosure, the operation offocusing the region of interest (ROI) may be an operation of displayingan image (e.g., a GUI element related to highlight, inversion, a box, anoval, animation, pin to screen, and/or an icon) indicating the region ofinterest (ROI).

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may maintain a view layout of thecaptured screen while displaying an image (e.g., a GUI element relatedto highlight, inversion, a box, an oval, animation, pin to screen,and/or an icon) indicating the region of interest (ROI), under controlof the processor (e.g., the processor 120 in FIG. 1 ), in operation1109. According to various embodiments of the disclosure, the operationof focusing the region of interest (ROI) may be an operation of placingan editing tool user interface (e.g., a “Crop image” user interface) tocenter on the region of interest (ROI) while displaying an image (e.g.,a GUI element related to highlight, inversion, a box, an oval, and/or anicon) indicating the region of interest (ROI).

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may select an object regionselected according to a user input under control of the processor (e.g.,the processor 120 in FIG. 1 ), in operation 1111.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may select an object regionselected according to a user input in a state where the region ofinterest (ROI) is focused, under control of the processor (e.g., theprocessor 120 in FIG. 1 ), in operation 1111. For example, a userinterface focused on the region of interest (ROI) may be moved accordingto the user input.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may capture a screen of theselected object region according to the command to capture the screen,under control of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 1113.

If the received command is a command to select an object region tocapture a screen, the electronic device (e.g., the electronic device 101in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may capture theobject region screen selected according to the user input under controlof the processor (e.g., the processor 120 in FIG. 1 ), in operation1113.

If the received command is a command to capture the entire screen, theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may capture the entire screen undercontrol of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 1113.

FIG. 12 is a flowchart illustrating an operation of performing an editaccording to a user input by an electronic device (e.g., the electronicdevice 101 in FIG. 1 , the electronic device 200 in FIG. 2A, or theelectronic device 300 in FIG. 3A) according to an embodiment of thedisclosure.

Referring to FIG. 12 , if a command to modify a captured screen isreceived, an electronic device (e.g., the electronic device 101 in FIG.1 , the electronic device 200 in FIG. 2A, or the electronic device 300in FIG. 3A) according to various embodiments may display an editing tooluser interface in at least a partial region of the captured screen undercontrol of a processor (e.g., the processor 120 in FIG. 1 ), inoperation 1201.

According to various embodiments of the disclosure, the editing tooluser interface may be a “Crop image” user interface. The “Crop image”user interface may be substantially rectangular and/or square, and mayinclude at least one of a rectangular and/or square edge and/or a squareor L-shaped bracket image neighboring a vertex. According to variousembodiments of the disclosure, the user input may be an input of movinga substantially rectangular and/or square end line, or the square orL-shaped bracket image of the “Crop image” user interface.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may determine whether an editingtool user interface corresponding to a user input has been moved, undercontrol of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 1203.

If it is determined that the editing tool user interface correspondingto the user input is moved, the electronic device (e.g., the electronicdevice 101 in FIG. 1 , the electronic device 200 in FIG. 2A, or theelectronic device 300 in FIG. 3A) according to various embodiments mayenter into operation 1205, under control of the processor (e.g., theprocessor 120 in FIG. 1 ), in operation 1203.

If it is determined that the editing tool user interface correspondingto the user input is not moved, the electronic device (e.g., theelectronic device 101 in FIG. 1 , the electronic device 200 in FIG. 2A,or the electronic device 300 in FIG. 3A) according to variousembodiments may enter into operation 1209, under control of theprocessor (e.g., the processor 120 in FIG. 1 ), in operation 1203.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may determine whether the editingtool user interface has been moved into a threshold region of an object,under control of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 1205.

According to various embodiments of the disclosure, the threshold regionof the object may be a region configured, as the periphery of an objectregion, to extend inside and outside the object region by apredetermined section (or length) with respect to the object region.According to various embodiments of the disclosure, the threshold regionof the object may not be displayed to be seen on the display.

According to various embodiments of the disclosure, the electronicdevice (e.g., the electronic device 101 in FIG. 1 , the electronicdevice 200 in FIG. 2A, or the electronic device 300 in FIG. 3A) maydetermine whether the substantially rectangular and/or square end line,or the square or L-shaped bracket image of the “Crop image” userinterface has been moved into the threshold region of the object, undercontrol of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 1205. According to various embodiments of the disclosure, ifit is determined that the substantially rectangular and/or square endline, or the square or L-shaped bracket image of the “Crop image” userinterface has been moved into the threshold region of the object, theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) may stop the movement and perform an operation of snapping to theobject region, under control of the processor (e.g., the processor 120in FIG. 1 ), in operation 1205.

If it is determined that the editing tool user interface has been movedin to the threshold region of the object, the electronic device (e.g.,the electronic device 101 in FIG. 1 , the electronic device 200 in FIG.2A, or the electronic device 300 in FIG. 3A) according to variousembodiments may enter operation 1207 under control of the processor(e.g., the processor 120 in FIG. 1 ), in operation 1205.

If it is determined that the editing tool user interface is not moved into the threshold region of the object, the electronic device (e.g., theelectronic device 101 in FIG. 1 , the electronic device 200 in FIG. 2A,or the electronic device 300 in FIG. 3A) according to variousembodiments may enter operation 1203 under control of the processor(e.g., the processor 120 in FIG. 1 ), in operation 1205.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may select the object regioncorresponding to the editing tool user interface having been movedaccording to the user input, under control of the processor (e.g., theprocessor 120 in FIG. 1 ), in operation 1207.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may select an object regioncorresponding to the current editing tool user interface, under controlof the processor (e.g., the processor 120 in FIG. 1 ), in operation1209.

FIG. 13 is a flowchart illustrating an operation of performing an editaccording to a user input by an electronic device (e.g., the electronicdevice 101 in FIG. 1 , the electronic device 200 in FIG. 2A, or theelectronic device 300 in FIG. 3A) according to an embodiment of thedisclosure.

Referring to FIG. 13 , an electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may obtain animage according to a user input, under control of a processor (e.g., theprocessor 120 in FIG. 1 ), in operation 1301.

According to various embodiments of the disclosure, the operation ofobtaining the image according to the user input may be an operation ofobtaining the image by moving a substantially rectangular and/or squareend line, or a square or L-shaped bracket image of a “Crop image” userinterface into a threshold region of an object, and selecting an objectregion corresponding to the editing tool user interface having beenmoved according to the user input.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may determine whether there is asimilar pattern or a grouped screen in a layout of the obtained image,under control of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 1303.

If there is a similar pattern or a grouped screen in the layout of theobtained image, the electronic device (e.g., the electronic device 101in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may enter intooperation 1305, under control of the processor (e.g., the processor 120in FIG. 1 ), in operation 1303.

If there is no similar pattern or grouped screen in the layout of theobtained image, the electronic device (e.g., the electronic device 101in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may enter intooperation 1307, under control of the processor (e.g., the processor 120in FIG. 1 ), in operation 1303.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may store the obtained imagetogether with the similar pattern or grouped screen existing in thelayout of the obtained image, under control of the processor (e.g., theprocessor 120 in FIG. 1 ), in operation 1305.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may store the image obtainedaccording to the user input under control of the processor (e.g., theprocessor 120 in FIG. 1 ), in operation 1307.

FIG. 14 is a flowchart illustrating a method for operating capturing byan electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to an embodiment of the disclosure.

Referring to FIG. 14 , an electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may capture aprocess screen displayed on a display (e.g., the display device 160 inFIG. 1 , the display 230 in FIG. 2A, or the display 301 in FIG. 3A)under control of a processor (e.g., the processor 120 in FIG. 1 ), inoperation 1401.

According to various embodiments of the disclosure, the displayedprocess screen may be a screen in which image or video information isdisplayed in a window and/or layout activated on the display (e.g., thedisplay device 160 in FIG. 1 , the display 230 in FIG. 2A, or thedisplay 301 in FIG. 3A).

According to various embodiments of the disclosure, the displayedprocess screen may include a user interface of a running application.The application may correspond to an application being executed in asingle window frame buffer screen or multiple window frame buffers.According to various embodiments of the disclosure, the capturingoperation may include an operation of obtaining and/or generating astill picture image of a screen displayed on the display (e.g., thedisplay device 160 in FIG. 1 , the display 230 in FIG. 2A, or thedisplay 301 in FIG. 3A).

According to various embodiments of the disclosure, the electronicdevice (e.g., the electronic device 101 in FIG. 1 , the electronicdevice 200 in FIG. 2A, or the electronic device 300 in FIG. 3A) mayobtain an image including a still picture of an image displayed on thedisplay (e.g., the display device 160 in FIG. 1 , the display 230 inFIG. 2A, or the display 301 in FIG. 3A), based on obtained renderinginformation under control of the processor (e.g., the processor 120 inFIG. 1 ), in operation 1401.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may extract additional informationaccording to a displayed process under control of the processor (e.g.,the processor 120 in FIG. 1 ), in operation 1403.

The operation of extracting the additional information according to thedisplayed process according to various embodiments may be an operationof providing a screen and/or function allowing the captured screen to beedited, under control of the processor (e.g., the processor 120 in FIG.1 ).

The operation of extracting the additional information according to thedisplayed process according to various embodiments may be an operationin which the electronic device (e.g., the electronic device 101 in FIG.1 , the electronic device 200 in FIG. 2A, or the electronic device 300in FIG. 3A) extracts the additional information from a frame buffer orthe application under control of the processor (e.g., the processor 120in FIG. 1 ), in operation 1403.

The operation of extracting the additional information according to thedisplayed process according to various embodiments may be an operationin which the electronic device (e.g., the electronic device 101 in FIG.1 , the electronic device 200 in FIG. 2A, or the electronic device 300in FIG. 3A) extracts the additional information from renderinginformation obtained from the application or the display (e.g., thedisplay device 160 in FIG. 1 , the display 230 in FIG. 2A, or thedisplay 301 in FIG. 3A) under control of a processor (e.g., theprocessor 120 in FIG. 1 ), in operation 1403.

In the electronic device (e.g., the electronic device 101 in FIG. 1 ,the electronic device 200 in FIG. 2A, or the electronic device 300 inFIG. 3A) according to various embodiments of the disclosure, theoperation of extracting a region and/or a block region of the stillpicture of the displayed process, under control of the processor (e.g.,the processor 120 in FIG. 1 ), in operation 1403, may be an operation ofextracting an image region and/or a text region in the still picture inunits of blocks.

In the electronic device (e.g., the electronic device 101 in FIG. 1 ,the electronic device 200 in FIG. 2A, or the electronic device 300 inFIG. 3A) according to various embodiments of the disclosure, theoperation of segmenting the still picture of the displayed process intoa region and/or a block region under control of the processor (e.g., theprocessor 120 in FIG. 1 ), in operation 1403, may be an operation ofsegmenting an image region and/or a text region in the still picture inunits of blocks.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may determine whether a pop-upobject exists in the captured screen, under control of the processor(e.g., the processor 120 in FIG. 1 ), in operation 1405.

If it is determined that there is a pop-up object in the capturedscreen, the electronic device (e.g., the electronic device 101 in FIG. 1, the electronic device 200 in FIG. 2A, or the electronic device 300 inFIG. 3A) according to various embodiments may enter into operation 1407under control of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 1405.

If it is determined that there is no pop-up object in the capturedscreen, the electronic device (e.g., the electronic device 101 in FIG. 1, the electronic device 200 in FIG. 2A, or the electronic device 300 inFIG. 3A) according to various embodiments may enter into operation 1409under control of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 1405.

According to various embodiments of the disclosure, the pop-up objectmay be a pop-up window, and/or an Internet advertisement view.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may separate a region of the pop-upobject from the captured screen and revise the captured screen undercontrol of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 1407. The operation of revising the captured screen may beperformed by compensating for a data loss of an image regioncorresponding to a region from which the pop-up object region isremoved, by using rendering information or additional information.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may separate and remove the pop-upobject region from the captured screen and may revise a captured screenpositioned below the pop-up object region, under control of theprocessor (e.g., the processor 120 in FIG. 1 ), in operation 1407. Theoperation of revising the captured screen positioned below the pop-upobject region may be performed by compensating for a data loss of animage region corresponding to a region from which the pop-up objectregion is removed, by using rendering information or additionalinformation.

In the electronic device (e.g., the electronic device 101 in FIG. 1 ,the electronic device 200 in FIG. 2A, or the electronic device 300 inFIG. 3A) according to various embodiments of the disclosure, theoperation of separating the region of the pop-up object from thecaptured screen and revising the captured screen under control of theprocessor (e.g., the processor 120 in FIG. 1 ), in operation 1407, maybe performed by removing the pop-up object and revising an image to be aregion of interest (ROI).

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may modify the captured screenunder control of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 1409.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may modify an object screencaptured in the frame buffer and/or the application under control of theprocessor (e.g., the processor 120 in FIG. 1 ), in operation 1409.

The operation of modifying the captured screen according to variousembodiments may be an operation of modifying the captured screen by auser input and/or a predetermined image editing process.

For example, in the operation of modifying the captured screen, a “Cropimage” operation may be performed by a user input. In the operation ofmodifying the captured screen, a “Crop image” operation may be performedby the predetermined image editing process.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may store, as a capture image,extracted object information and the captured screen under control ofthe processor (e.g., the processor 120 in FIG. 1 ), in operation 1411.According to various embodiments of the disclosure, the operation ofstoring the captured screen as a capture image may also include anoperation of storing a screen in which an image is not modified by auser.

FIG. 15 is a flowchart illustrating a method for operating capturing byan electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to an embodiment of the disclosure.

Referring to FIG. 15 , an electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may capture aprocess screen displayed on a display (e.g., the display device 160 inFIG. 1 , the display 230 in FIG. 2A, or the display 301 in FIG. 3A)under control of a processor (e.g., the processor 120 in FIG. 1 ), inoperation 1501.

According to various embodiments of the disclosure, the displayedprocess screen may be a screen in which image or video information isdisplayed in a window and/or layout activated on the display (e.g., thedisplay device 160 in FIG. 1 , the display 230 in FIG. 2A, or thedisplay 301 in FIG. 3A).

According to various embodiments of the disclosure, the displayedprocess screen may include a user interface of a running application.The application may correspond to an application being executed in asingle window frame buffer screen or multiple window frame buffers.According to various embodiments of the disclosure, the capturingoperation may include an operation of obtaining and/or generating astill picture image of a screen displayed on the display (e.g., thedisplay device 160 in FIG. 1 , the display 230 in FIG. 2A, or thedisplay 301 in FIG. 3A).

According to various embodiments of the disclosure, the electronicdevice (e.g., the electronic device 101 in FIG. 1 , the electronicdevice 200 in FIG. 2A, or the electronic device 300 in FIG. 3A) mayobtain an image including a still picture of an image displayed on thedisplay (e.g., the display device 160 in FIG. 1 , the display 230 inFIG. 2A, or the display 301 in FIG. 3A), based on obtained renderinginformation under control of the processor (e.g., the processor 120 inFIG. 1 ), in operation 1501.

According to various embodiments of the disclosure, a command to capturea screen of the electronic device (e.g., the electronic device 101 inFIG. 1 , the electronic device 200 in FIG. 2A, or the electronic device300 in FIG. 3A) may include a command to select an object region tocapture a screen and/or a command to capture the entire screen.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may extract additional informationaccording to a displayed process under control of the processor (e.g.,the processor 120 in FIG. 1 ), in operation 1503.

The operation of extracting the additional information according to thedisplayed process according to various embodiments may be an operationof providing a screen and/or function allowing the captured screen to beedited, under control of the processor (e.g., the processor 120 in FIG.1 ).

The operation of extracting the additional information according to thedisplayed process according to various embodiments may be an operationin which the electronic device (e.g., the electronic device 101 in FIG.1 , the electronic device 200 in FIG. 2A, or the electronic device 300in FIG. 3A) extracts the additional information from a frame buffer orthe application under control of the processor (e.g., the processor 120in FIG. 1 ), in operation 1503.

The operation of extracting the additional information according to thedisplayed process according to various embodiments may be an operationin which the electronic device (e.g., the electronic device 101 in FIG.1 , the electronic device 200 in FIG. 2A, or the electronic device 300in FIG. 3A) extracts the additional information from renderinginformation obtained from the application or the display (e.g., thedisplay device 160 in FIG. 1 , the display 230 in FIG. 2A, or thedisplay 301 in FIG. 3A) under control of the processor (e.g., theprocessor 120 in FIG. 1 ), in operation 1503.

In the electronic device (e.g., the electronic device 101 in FIG. 1 ,the electronic device 200 in FIG. 2A, or the electronic device 300 inFIG. 3A) according to various embodiments of the disclosure, theoperation of extracting a region and/or a block region of the stillpicture of the displayed process, under control of the processor (e.g.,the processor 120 in FIG. 1 ), in operation 1503, may be an operation ofextracting an image region and/or a text region in the still picture inunits of blocks.

In the electronic device (e.g., the electronic device 101 in FIG. 1 ,the electronic device 200 in FIG. 2A, or the electronic device 300 inFIG. 3A) according to various embodiments of the disclosure, theoperation of segmenting the still picture of the displayed process intoa region and/or a block region under control of the processor (e.g., theprocessor 120 in FIG. 1 ), in operation 1503, may be an operation ofsegmenting an image region and/or a text region in the still picture inunits of blocks.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may determine whether there is adisplayed horizontal slide image, under control of the processor (e.g.,the processor 120 in FIG. 1 ), in operation 1505.

If it is determined that there is a displayed horizontal slide image,the electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may enter into operation 1507 undercontrol of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 1505.

If it is determined that there is no displayed horizontal slide image,the electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may enter into operation 1509 undercontrol of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 1505.

According to various embodiments of the disclosure, the horizontal slideimage may be an image configured in the horizontal scroll direction inthe currently displayed screen, rather than the vertical scrolldirection.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may separate the horizontal slideimage and revise the captured screen under control of the processor(e.g., the processor 120 in FIG. 1 ), in operation 1507.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may merge images included in thehorizontal slides in the captured image to revise the captured screenunder control of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 1507.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may modify the captured screenunder control of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 1509.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may modify an object screencaptured in the frame buffer and/or the application under control of theprocessor (e.g., the processor 120 in FIG. 1 ), in operation 1509.

The operation of modifying the captured screen according to variousembodiments may be an operation of modifying the captured screen by auser input and/or a predetermined image editing process.

For example, in the operation of modifying the captured screen, a “Cropimage” operation may be performed by a user input. In the operation ofmodifying the captured screen, a “Crop image” operation may be performedby the predetermined image editing process.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may store, as a capture image,extracted object information and the captured screen under control ofthe processor (e.g., the processor 120 in FIG. 1 ), in operation 1511.According to various embodiments of the disclosure, the operation ofstoring the captured screen as a capture image may also include anoperation of storing a screen in which an image is not modified by auser.

FIG. 16 is a flowchart illustrating a method for operating capturing byan electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to an embodiment of the disclosure.

Referring to FIG. 16 , an electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may capture aprocess screen displayed on a display (e.g., the display device 160 inFIG. 1 , the display 230 in FIG. 2A, or the display 301 in FIG. 3A)under control of a processor (e.g., the processor 120 in FIG. 1 ), inoperation 1601.

According to various embodiments of the disclosure, the displayedprocess screen may be a screen in which image or video information isdisplayed in a window and/or layout activated on the display (e.g., thedisplay device 160 in FIG. 1 , the display 230 in FIG. 2A, or thedisplay 301 in FIG. 3A).

According to various embodiments of the disclosure, the displayedprocess screen may include a user interface of a running application.The application may correspond to an application being executed in asingle window frame buffer screen or multiple window frame buffers.According to various embodiments of the disclosure, the capturingoperation may include an operation of obtaining and/or generating astill picture image of a screen displayed on the display (e.g., thedisplay device 160 in FIG. 1 , the display 230 in FIG. 2A, or thedisplay 301 in FIG. 3A).

According to various embodiments of the disclosure, the electronicdevice (e.g., the electronic device 101 in FIG. 1 , the electronicdevice 200 in FIG. 2A, or the electronic device 300 in FIG. 3A) mayobtain an image including a still picture of an image displayed on thedisplay (e.g., the display device 160 in FIG. 1 , the display 230 inFIG. 2A, or the display 301 in FIG. 3A), based on obtained renderinginformation under control of the processor (e.g., the processor 120 inFIG. 1 ), in operation 1601.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may extract additional informationaccording to a displayed process under control of the processor (e.g.,the processor 120 in FIG. 1 ), in operation 1603.

The operation of extracting the additional information according to thedisplayed process according to various embodiments may be an operationof providing a screen and/or function allowing the captured screen to beedited, under control of the processor (e.g., the processor 120 in FIG.1 ).

The operation of extracting the additional information according to thedisplayed process according to various embodiments may be an operationin which the electronic device (e.g., the electronic device 101 in FIG.1 , the electronic device 200 in FIG. 2A, or the electronic device 300in FIG. 3A) extracts the additional information from a frame buffer orthe application under control of the processor (e.g., the processor 120in FIG. 1 ), in operation 1603.

The operation of extracting the additional information according to thedisplayed process according to various embodiments may be an operationin which the electronic device (e.g., the electronic device 101 in FIG.1 , the electronic device 200 in FIG. 2A, or the electronic device 300in FIG. 3A) extracts the additional information from renderinginformation obtained from the application or the display (e.g., thedisplay device 160 in FIG. 1 , the display 230 in FIG. 2A, or thedisplay 301 in FIG. 3A) under control of the processor (e.g., theprocessor 120 in FIG. 1 ), in operation 1603.

In the electronic device (e.g., the electronic device 101 in FIG. 1 ,the electronic device 200 in FIG. 2A, or the electronic device 300 inFIG. 3A) according to various embodiments of the disclosure, theoperation of extracting a region and/or a block region of the stillpicture of the displayed process, under control of the processor (e.g.,the processor 120 in FIG. 1 ), in operation 1603, may be an operation ofextracting an image region and/or a text region in the still picture inunits of blocks.

In the electronic device (e.g., the electronic device 101 in FIG. 1 ,the electronic device 200 in FIG. 2A, or the electronic device 300 inFIG. 3A) according to various embodiments of the disclosure, theoperation of segmenting the still picture of the displayed process intoa region and/or a block region under control of the processor (e.g., theprocessor 120 in FIG. 1 ), in operation 1603, may be an operation ofsegmenting an image region and/or a text region in the still picture inunits of blocks.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may determine whether there is animage at a boundary of the display, under control of the processor(e.g., the processor 120 in FIG. 1 ), in operation 1605.

If it is determined that there is an image at the boundary of thedisplay, the electronic device (e.g., the electronic device 101 in FIG.1 , the electronic device 200 in FIG. 2A, or the electronic device 300in FIG. 3A) according to various embodiments may enter into operation1607 under control of the processor (e.g., the processor 120 in FIG. 1), in operation 1605.

If it is determined that there is no image at the boundary of thedisplay, the electronic device (e.g., the electronic device 101 in FIG.1 , the electronic device 200 in FIG. 2A, or the electronic device 300in FIG. 3A) according to various embodiments may enter into operation1609 under control of the processor (e.g., the processor 120 in FIG. 1), in operation 1605.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may determine whether an imagewhich failed to be captured exists at a boundary of a captured image,under control of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 1605.

If it is determined that an image which failed to be captured exists atthe boundary of the captured image, the electronic device (e.g., theelectronic device 101 in FIG. 1 , the electronic device 200 in FIG. 2A,or the electronic device 300 in FIG. 3A) according to variousembodiments may enter into operation 1607 under control of the processor(e.g., the processor 120 in FIG. 1 ), in operation 1605.

If it is determined that an image which failed to be captured does notexist at the boundary of the captured image, the electronic device(e.g., the electronic device 101 in FIG. 1 , the electronic device 200in FIG. 2A, or the electronic device 300 in FIG. 3A) according tovarious embodiments may enter into operation 1609 under control of theprocessor (e.g., the processor 120 in FIG. 1 ), in operation 1605.

If it is determined that an image which failed to be captured exists atthe boundary of the captured image, the electronic device (e.g., theelectronic device 101 in FIG. 1 , the electronic device 200 in FIG. 2A,or the electronic device 300 in FIG. 3A) according to variousembodiments may separate the image and revise the captured screen to bea continuous image under control of the processor (e.g., the processor120 in FIG. 1 ), in operation 1607.

If it is determined that an image which failed to be captured exists atthe boundary of the captured image, the electronic device (e.g., theelectronic device 101 in FIG. 1 , the electronic device 200 in FIG. 2A,or the electronic device 300 in FIG. 3A) according to variousembodiments may separate the image and merge the captured image and theimage which failed to be captured into a continuous image so as torevise the captured screen under control of the processor (e.g., theprocessor 120 in FIG. 1 ), in operation 1607. The operation of revisingthe captured screen may be performed by compensating for a data loss ofan image corresponding to a region which failed to be captured by usingrendering information or additional information, to make a continuousimage.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may modify the captured screenunder control of the processor (e.g., the processor 120 in FIG. 1 ), inoperation 1609.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may modify an object screencaptured in the frame buffer and/or the application under control of theprocessor (e.g., the processor 120 in FIG. 1 ), in operation 1609.

The operation of modifying the captured screen according to variousembodiments may be an operation of modifying the captured screen by auser input and/or a predetermined image editing process.

For example, in the operation of modifying the captured screen, a “Cropimage” operation may be performed by a user input. In the operation ofmodifying the captured screen, a “Crop image” operation may be performedby the predetermined image editing process.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may store, as a capture image,extracted object information and the captured screen under control ofthe processor (e.g., the processor 120 in FIG. 1 ), in operation 1611.According to various embodiments of the disclosure, the operation ofstoring the captured screen as a capture image may also include anoperation of storing a screen in which an image is not modified by auser.

FIG. 17A is a diagram illustrating an operation of extracting additionalinformation according to a displayed process by an electronic device(e.g., the electronic device 101 in FIG. 1 , the electronic device 200in FIG. 2A, or the electronic device 300 in FIG. 3A) according to anembodiment of the disclosure.

FIG. 17B is a diagram illustrating an operation of suggesting a regionof interest (ROI) by an electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to an embodiment of the disclosure.

Referring to FIGS. 9, 10, 17A, and 17B, the electronic device (e.g., theelectronic device 101 in FIG. 1 , the electronic device 200 in FIG. 2A,or the electronic device 300 in FIG. 3A) according to variousembodiments may extract additional information according to a displayedprocess under control of a processor (e.g., the processor 120 in FIG. 1).

The operation of extracting the additional information according to thedisplayed process according to various embodiments may be an operationof extracting a region and/or a block region 1702, 1703, 1704, or 1705of a still picture 1701 of a displayed process, under control of aprocessor (e.g., the processor 120 in FIG. 1 ).

Referring to FIG. 17A, the electronic device 101 may extract at leastone block region 1702, 1703, 1704, or 1705 from the still picture 1701of a process displayed on a display (e.g., the display device 160 inFIG. 1 ). The electronic device 101 may place an editing tool userinterface (e.g., a “Crop image” user interface 1720) which is movableaccording to a user input, on the still picture 1701 of a processdisplayed on the display (e.g., the display device 160 in FIG. 1 ).

Referring to FIG. 17B, the electronic device 101 may suggest a region ofinterest (ROI) 1710 in the still picture 1701 of a process displayed onthe display (e.g., the display device 160 in FIG. 1 ).

According to various embodiments of the disclosure, under control of theprocessor (e.g., the processor 120 in FIG. 1 ), the electronic device(e.g., the electronic device 101 in FIG. 1 , the electronic device 200in FIG. 2A, or the electronic device 300 in FIG. 3A) may separate animage region and/or a text region by using region information, blockregion information, or the like, extracted from the captured screen 1701as additional information, and if a particular region is included in thecaptured screen 1701, the electronic device may determine the particularregion as a region of interest (ROI) 1710. For example, the particularregion may be an image region.

According to various embodiments of the disclosure, under control of theprocessor (e.g., the processor 120 in FIG. 1 ), the electronic device(e.g., the electronic device 101 in FIG. 1 , the electronic device 200in FIG. 2A, or the electronic device 300 in FIG. 3A) may separate animage region and/or a text region by using region information, blockregion information, or the like, extracted from the captured screen 1701as additional information, and if the ratio of a particular region inthe capture screen is equal to or larger than a pre-configured ratio,the electronic device may determine the particular region as the regionof interest (ROI) 1710. For example, the pre-configured ratio may be12%.

Under control of the processor (e.g., the processor 120 in FIG. 1 ), theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may separate an image region and/ora text region by using region information, block region information, orthe like, extracted from the captured screen 1701 as additionalinformation, and if the ratio of a plurality of particular regions inthe capture screen 1701 is equal to or larger than the pre-configuredratio, the electronic device may determine the largest region as theregion of interest (ROI) 1710.

According to various embodiments of the disclosure, the operation ofsuggesting the region of interest (ROI) 1710 may be an operation ofdisplaying an image (e.g., a GUI element related to highlight,inversion, a box, and/or an icon) indicating the region of interest(ROI), during a pre-configured time interval. If the pre-configured timeinterval has passed, the image (e.g., a GUI element related tohighlight, inversion, a box, and/or an icon) indicating the region ofinterest (ROI) 1710 may disappear.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may maintain a view layout of thecaptured screen while displaying an image 1710 (e.g., a GUI elementrelated to highlight, inversion, a box, and/or an icon) indicating aregion of interest (ROI), during a pre-configured time interval, undercontrol of the processor (e.g., the processor 120 in FIG. 1 ).

FIG. 18 is a diagram illustrating an operation of modifying a capturedscreen by an electronic device (e.g., the electronic device 101 in FIG.1 , the electronic device 200 in FIG. 2A, or the electronic device 300in FIG. 3A) according to an embodiment of the disclosure.

Referring to FIG. 18 , in the stage indicated by reference numeral 1801,an electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) may provide a screen and/or a function allowing a captured screen tobe edited, under control of a processor (e.g., the processor 120 in FIG.1 ). The function for editing the captured screen may include Cropimage, Reduce/Enlarge image, Rotate image, image effect, image colortemperature, image color correction, or the like. The electronic device(e.g., the electronic device 101 in FIG. 1 , the electronic device 200in FIG. 2A, or the electronic device 300 in FIG. 3A) may provide, as auser interface, an icon, an image, or a text corresponding to thefunction for editing the captured screen in a tool bar type on a display(e.g., the display device 160 in FIG. 1 ). The screen and/or functionallowing the captured screen to be edited may correspond to a screenshottoolbar 1810.

In the stage 1803, the electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) may determine whether a region of interest (ROI)exists in the captured screen, under control of the processor (e.g., theprocessor 120 in FIG. 1 ).

In the stage 1805, if a region of interest (ROI) exists in the capturedscreen 1820, the electronic device (e.g., the electronic device 101 inFIG. 1 , the electronic device 200 in FIG. 2A, or the electronic device300 in FIG. 3A) may perform an operation 1830 of suggesting the regionof interest (ROI) under control of the processor (e.g., the processor120 in FIG. 1 ).

According to various embodiments of the disclosure, the operation ofsuggesting the region of interest (ROI) may be an operation ofdisplaying an image 1830 (e.g., a GUI element related to highlight,inversion, a box, and/or an icon) indicating the region of interest(ROI), during a pre-configured time interval. If the pre-configured timeinterval has passed, the image 1830 (e.g., a GUI element related tohighlight, inversion, a box, and/or an icon) indicating the region ofinterest (ROI) may disappear.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may maintain the view layout 1820of the captured screen while displaying the image 1830 (e.g., a GUIelement related to highlight, inversion, a box, and/or an icon)indicating a region of interest (ROI), during a pre-configured timeinterval, under control of the processor (e.g., the processor 120 inFIG. 1 ).

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may place an editing tool userinterface 1840 (e.g., a “Crop image” user interface) which is movableaccording to a user input, while displaying the image 1830 (e.g., a GUIelement related to highlight, inversion, a box, and/or an icon)indicating the region of interest (ROI), under control of the processor(e.g., the processor 120 in FIG. 1 ).

In the stage 1807, if a region of interest (ROI) 1850 is selected, theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may allow the editing tool userinterface 1840 (e.g., a “Crop image” user interface) to snap to theselected region of interest (ROI) 1850 under control of the processor(e.g., the processor 120 in FIG. 1 ).

In the stage 1809, if a region of interest (ROI) does not exist, theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may display the editing tool userinterface 1840 (e.g., a “Crop image” user interface) for the entirescreen under control of the processor (e.g., the processor 120 in FIG. 1).

FIG. 19 is a diagram illustrating an operation of modifying a capturedscreen by an electronic device (e.g., the electronic device 101 in FIG.1 , the electronic device 200 in FIG. 2A, or the electronic device 300in FIG. 3A) according to an embodiment of the disclosure.

Referring to FIG. 19 , in the stage 1901, an electronic device (e.g.,the electronic device 101 in FIG. 1 , the electronic device 200 in FIG.2A, or the electronic device 300 in FIG. 3A) may provide a screen and/ora function 1910 allowing a captured screen 1920 to be edited, to adisplay (e.g., the display device 160 in FIG. 1 ), under control of aprocessor (e.g., the processor 120 in FIG. 1 ). The function 1910 forediting the captured screen may include Crop image, Reduce/Enlargeimage, Rotate image, image effect, image color temperature, image colorcorrection, or the like. The electronic device (e.g., the electronicdevice 101 in FIG. 1 , the electronic device 200 in FIG. 2A, or theelectronic device 300 in FIG. 3A) may provide an icon, an image, or atext corresponding to the function for editing the captured screen as auser interface, which is of a tool bar type, on the display (e.g., thedisplay device 160 in FIG. 1 ). The screen and/or function allowing thecaptured screen 1920 to be edited may correspond to the screenshottoolbar 1910.

In the stage 1903, the electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) may determine whether a region of interest (ROI)exists in the captured screen 1920, under control of the processor(e.g., the processor 120 in FIG. 1 ).

If there is a region of interest (ROI) in the captured screen 1920, theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) may perform an operation 1930 of suggesting the region of interest(ROI), under control of the processor (e.g., the processor 120 in FIG. 1).

According to various embodiments of the disclosure, the operation ofsuggesting the region of interest (ROI) may be an operation ofdisplaying an image 1930 (e.g., a GUI element related to highlight,inversion, a box, and/or an icon) indicating the region of interest(ROI), during a pre-configured time interval. If the pre-configured timeinterval has passed, the image 1930 (e.g., a GUI element related tohighlight, inversion, a box, and/or an icon) indicating the region ofinterest (ROI) may disappear.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may maintain the view layout 1920of the captured screen while displaying the image 1930 (e.g., a GUIelement related to highlight, inversion, a box, and/or an icon)indicating a region of interest (ROI), during a pre-configured timeinterval, under control of the processor (e.g., the processor 120 inFIG. 1 ).

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may place an editing tool userinterface 1940 (e.g., a “Crop image” user interface) which is movableaccording to a user input, while displaying the image 1930 (e.g., a GUIelement related to highlight, inversion, a box, and/or an icon)indicating the region of interest (ROI), under control of the processor(e.g., the processor 120 in FIG. 1 ).

In the stage 1905, if the region of interest (ROI) 1950 is selected, theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may allow the editing tool userinterface 1940 (e.g., a “Crop image” user interface) to snap to theselected region of interest (ROI) 1950 while maintaining the view layout1920 of the captured screen, under control of the processor (e.g., theprocessor 120 in FIG. 1 ).

FIG. 20 is a diagram illustrating an operation of performing an editaccording to a user input by an electronic device (e.g., the electronicdevice 101 in FIG. 1 , the electronic device 200 in FIG. 2A, or theelectronic device 300 in FIG. 3A) according to an embodiment of thedisclosure.

Referring to FIG. 20 , a threshold region of the object may be a regionconfigured, as the periphery of an object region 2010, to extend insideand outside the object region 2010 by a predetermined section (orlength) with respect to the object region. According to variousembodiments of the disclosure, the threshold region of the object maynot be displayed to be seen on a display.

As indicated by reference numeral 2001, the threshold region of theobject may be a region configured to extend inside and outside theobject region 2010 from the horizontal periphery of the object region2010 by a predetermined section (or length).

As indicated by reference numeral 2003, the threshold region of theobject may be a region configured to extend inside and outside theobject region 2010 from the vertical periphery of the object region 2010by a predetermined section (or length).

FIG. 21 is a diagram illustrating an operation of performing an editaccording to a user input by an electronic device (e.g., the electronicdevice 101 in FIG. 1 , the electronic device 200 in FIG. 2A, or theelectronic device 300 in FIG. 3A) according to an embodiment of thedisclosure.

Referring to FIG. 21 , in the stage 2101, a threshold region 2110 of anobject may be a region configured to extend inside and outside an objectregion 2010 from the horizontal periphery of the object region 2010 by apredetermined section (or length). A “Crop image” user interface 2120may be displayed. The “Crop image” user interface 2120 may besubstantially rectangular and/or square, and may include at least one ofa rectangular and/or square edge and/or a square or L-shaped bracketimage neighboring a vertex.

In the stage 2103, if a substantially rectangular and/or square endline, or the square or L-shaped bracket image of the “Crop image” userinterface 2120 is moved into the threshold region 2110 of the object, anoperation of selecting the object region 2010 may be performed. Theoperation of selecting the object region 2010 may be an operation ofsnapping to the object region 2010.

In the stage 2105, if a substantially rectangular and/or square endline, or the square or L-shaped bracket image of the “Crop image” userinterface 2120 is moved out of the threshold region 2110 of the object,an operation of releasing the selection of the object region 2010 may beperformed. The operation of releasing the selection of the object region2010 may be an operation of releasing the snapping to the object region2010.

FIG. 22 is a diagram illustrating an operation of performing an editaccording to a user input by an electronic device (e.g., the electronicdevice 101 in FIG. 1 , the electronic device 200 in FIG. 2A, or theelectronic device 300 in FIG. 3A) according to an embodiment of thedisclosure.

Referring to FIG. 22 , in the stage 2201, in an operation of modifying acaptured screen, if a region of interest (ROI) 2220 is selected, a firstedit screen may be displayed. The first edit screen may be an editscreen in which a view layout 2210 of the captured screen is maintainedwhile an editing tool user interface (e.g., a “Crop image” userinterface) 2230 is placed to center on the region of interest (ROI)2220. The region other than the region of interest (ROI) 2220 in thecaptured screen may be processed to be darker than the region ofinterest (ROI) 2220, so as to be displayed. In the operation ofmodifying the captured screen, a substantially rectangular and/or squareend line, or a square or L-shaped bracket image of the “Crop image” userinterface 2230 may be moved into another region 2250.

In the stage 2203, in the operation of modifying the captured screen,the substantially rectangular and/or square end line, or the square orL-shaped bracket image of the “Crop image” user interface 2230 may bemoved to modify the user interface to include the other region 2250 inaddition to the region of interest (ROI) 2220.

In the stage 2203, the electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may allow the“Crop image” user interface 2230 to snap to a new object region 2240 toinclude the additionally selected region 2250.

FIG. 23 is a diagram illustrating an operation of performing an editaccording to a user input by an electronic device (e.g., the electronicdevice 101 in FIG. 1 , the electronic device 200 in FIG. 2A, or theelectronic device 300 in FIG. 3A) according to an embodiment of thedisclosure.

Referring to FIG. 23 , in the stage 2301, in an operation of modifying acaptured screen, if a region of interest (ROI) 2320 is selected, a firstedit screen may be displayed. The first edit screen may be an editscreen in which a view layout 2310 of the captured screen is maintainedwhile an editing tool user interface (e.g., a “Crop image” userinterface) 2330 is placed to center on the region of interest (ROI)2320. The region other than the region of interest (ROI) 2320 in thecaptured screen may be processed to be darker than the region ofinterest (ROI), so as to be displayed. In the operation of modifying thecaptured screen, a substantially rectangular and/or square end line, ora square or L-shaped bracket image of the “Crop image” user interface2330 may be moved into another region 2350.

In the stage 2303, in the operation of modifying the captured screen,the substantially rectangular and/or square end line, or the square orL-shaped bracket image of the “Crop image” user interface 2330 may bemoved to modify the user interface to include the other region 2350 inaddition to the region of interest (ROI) 2220.

In the stage 2303, the electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may allow the“Crop image” user interface 2330 to snap to a new object region 2340 toinclude the selected other region 2350.

FIG. 24 is a diagram illustrating an operation of capturing a displayedprocess screen by an electronic device (e.g., the electronic device 101in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to an embodiment of the disclosure.

Referring to FIG. 24 , in the stage 2401, if it is determined that areceived command is a command to select an object region to capture ascreen, the electronic device (e.g., the electronic device 101 in FIG. 1, the electronic device 200 in FIG. 2A, or the electronic device 300 inFIG. 3A) may display a user interface 2420 by which an object region canbe selected and a screen thereof can be captured, under control of aprocessor (e.g., the processor 120 in FIG. 1 ).

In the stage 2403, if it is determined that a received command is acommand to select an object region to capture a screen, and there is aregion of interest (ROI) 2430 in a captured screen 2410, the electronicdevice (e.g., the electronic device 101 in FIG. 1 , the electronicdevice 200 in FIG. 2A, or the electronic device 300 in FIG. 3A) maydisplay the user interface 2420 by which an object region centered onthe region of interest (ROI) 2430 can be selected and a screen thereofcan be captured, under control of the processor (e.g., the processor 120in FIG. 1 ). An operation of focusing the region of interest (ROI) 2430may be performed. The operation may correspond to the view layout 2410in which a region around the region of interest (ROI) 2430 is processedto be brightened, and the region other than the region of interest (ROI)is processed to be darkened. The operation of focusing the region ofinterest (ROI) 2430 may be an operation of placing an editing tool userinterface (e.g., a “Crop image” user interface) to center on the regionof interest (ROI) 2430 while displaying an image (e.g., a box GUIelement) indicating the region of interest (ROI) 2430.

FIG. 25 is a diagram illustrating an operation of capturing a displayedprocess screen by an electronic device (e.g., the electronic device 101in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to an embodiment of the disclosure.

Referring to FIG. 25 , in the stage 2501, if it is determined that areceived command is a command to select an object region to capture ascreen, the electronic device (e.g., the electronic device 101 in FIG. 1, the electronic device 200 in FIG. 2A, or the electronic device 300 inFIG. 3A) may display a user interface 2520 by which an object region canbe selected and a screen thereof can be captured, under control of aprocessor (e.g., the processor 120 in FIG. 1 ).

In the stage 2503, if it is determined that a received command is acommand to select an object region to capture a screen, and there is aregion of interest (ROI) 2530 in a captured screen 2510, the electronicdevice (e.g., the electronic device 101 in FIG. 1 , the electronicdevice 200 in FIG. 2A, or the electronic device 300 in FIG. 3A) maydisplay the user interface 2520 by which an object region centered onthe region of interest (ROI) 2530 can be selected and a screen thereofcan be captured, under control of the processor (e.g., the processor 120in FIG. 1 ). An operation of focusing the region of interest (ROI) 2530may be performed. The operation may correspond to the view layout 2510in which a region around the region of interest (ROI) 2530 is processedto be brightened, and the region other than the region of interest (ROI)is processed to be darkened. The operation of focusing the region ofinterest (ROI) 2530 may be an operation of placing an editing tool userinterface (e.g., a “Crop image” user interface) to center on the regionof interest (ROI) 2530 while displaying an image (e.g., an oval GUIelement) indicating the region of interest (ROI) 2530.

FIG. 26 is a diagram illustrating an operation of capturing a displayedprocess screen by an electronic device (e.g., the electronic device 101in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to an embodiment of the disclosure.

Referring to FIG. 26 , in the stage 2601, if it is determined that areceived command is a command to select an object region to capture ascreen, the electronic device (e.g., the electronic device 101 in FIG. 1, the electronic device 200 in FIG. 2A, or the electronic device 300 inFIG. 3A) may display a user interface 2640 by which an object region canbe selected and a screen thereof can be captured, under control of aprocessor (e.g., the processor 120 in FIG. 1 ). A captured screen 2610may include an image region 2620 and a text region 2630.

In the stage 2603, if it is determined that a received command is acommand to select an object region to capture a screen, and there is theregion of interest (ROI) 2620 in the captured screen 2610, theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) may display the user interface 2640 by which an object regioncentered on the region of interest (ROI) 2620 can be selected and ascreen thereof can be captured, under control of the processor (e.g.,the processor 120 in FIG. 1 ). An operation of focusing the region ofinterest (ROI) 2620 may be performed. The operation may correspond tothe view layout 2610 in which a region around the region of interest(ROI) 2620 is processed to be brightened, and the region other than theregion of interest (ROI) is processed to be darkened. The operation offocusing the region of interest (ROI) 2620 may be an operation ofdisplaying an animation of moving an image indicating the region ofinterest (ROI) 2620 to the region of interest (ROI). In addition, anediting tool user interface (e.g., a “Crop image” user interface) may beplaced to center on the region of interest (ROI) 2620.

FIG. 27 is a diagram illustrating an operation of capturing a displayedprocess screen by an electronic device (e.g., the electronic device 101in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to an embodiment of the disclosure.

Referring to FIG. 27 , in the stage 2701, if it is determined that areceived command is a command to select an object region to capture ascreen, the electronic device (e.g., the electronic device 101 in FIG. 1, the electronic device 200 in FIG. 2A, or the electronic device 300 inFIG. 3A) may display a user interface 2730 by which an object region canbe selected and a screen thereof can be captured, under control of aprocessor (e.g., the processor 120 in FIG. 1 ). A captured screen 2710may include an image region 2720 and a text region 2740.

In the stage 2703, if it is determined that a received command is acommand to select an object region to capture a screen, and there is theregion of interest (ROI) 2720 in the captured screen 2710, theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) may display the user interface 2730 by which an object regioncentered on the region of interest (ROI) 2720 can be selected and ascreen thereof can be captured, under control of the processor (e.g.,the processor 120 in FIG. 1 ). An operation of focusing the region ofinterest (ROI) 2720 may be performed. The operation may correspond tothe view layout 2710 in which a region around the region of interest(ROI) 2720 is processed to be brightened, and the region other than theregion of interest (ROI) is processed to be darkened. The operation offocusing the region of interest (ROI) 2720 may be an operation ofdisplaying a pin-to-screen animation of enlarging an image indicatingthe region of interest (ROI) 2720 to the region of interest (ROI). Inaddition, an editing tool user interface (e.g., a “Crop image” userinterface) may be placed to center on the region of interest (ROI) 2620.

FIG. 28 is a diagram illustrating a method for operating capturing by anelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to an embodiment of the disclosure.

Referring to FIG. 28 , in the stage 2801, an electronic device (e.g.,the electronic device 101 in FIG. 1 , the electronic device 200 in FIG.2A, or the electronic device 300 in FIG. 3A) may capture a processscreen 2850 displayed on a display (e.g., the display device 160 in FIG.1 , the display 230 in FIG. 2A, or the display 301 in FIG. 3A) undercontrol of a processor (e.g., the processor 120 in FIG. 1 ).

In the stages 2801 and 2803, the captured screen 2850 may include atleast one object region 2811, 2812, 2813, 2814, 2815, 2816 and 2817. Theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) may determine whether there is the pop-up object region 2817 in thecaptured screen 2850, under control of the processor (e.g., theprocessor 120 in FIG. 1 ). The pop-up object region 2817 may be a pop-upwindow.

In the stage 2805, the pop-up object region 2817 may be separated andremoved from the captured screen 2850, and the captured screen 2811positioned below the pop-up object region 2817 may be revised. In theoperation of separating the pop-up object region 2817 from the capturedscreen 2850 and revising the captured screen 2850, the pop-up objectregion 2817 may be removed and an image may be revised and stored todisplay the region of interest (ROI) 2811.

FIG. 29 is a diagram illustrating a method for operating capturing by anelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to an embodiment of the disclosure.

Referring to FIG. 29 , in the stage 2901, an electronic device (e.g.,the electronic device 101 in FIG. 1 , the electronic device 200 in FIG.2A, or the electronic device 300 in FIG. 3A) may capture a processscreen 2950 displayed on a display (e.g., the display device 160 in FIG.1 , the display 230 in FIG. 2A, or the display 301 in FIG. 3A) undercontrol of a processor (e.g., the processor 120 in FIG. 1 ).

In the stages 2901 and 2903, the captured screen 2950 may include atleast one object region 2910 and 2920. The electronic device (e.g., theelectronic device 101 in FIG. 1 , the electronic device 200 in FIG. 2A,or the electronic device 300 in FIG. 3A) may determine whether there isthe pop-up object region 2910 in the captured screen 2950, under controlof the processor (e.g., the processor 120 in FIG. 1 ). The pop-up objectregion 2910 may be a pop-up window.

In the stage 2905, the pop-up object region 2910 may be separated andremoved from the captured screen 2950, and the captured screen 2920positioned below the pop-up object region 2910 may be revised. In theoperation of separating the pop-up object region 2910 from the capturedscreen 2950 and revising the captured screen 2950, the pop-up objectregion 2910 may be removed and an image may be revised and stored todisplay the region of interest (ROI) 2920.

FIG. 30 illustrates a sequence of an operation of performing an editaccording to a user input by an electronic device (e.g., the electronicdevice 101 in FIG. 1 , the electronic device 200 in FIG. 2A, or theelectronic device 300 in FIG. 3A) according to an embodiment of thedisclosure.

Referring to FIG. 30 , in the stage 3001, an electronic device (e.g.,the electronic device 101 in FIG. 1 , the electronic device 200 in FIG.2A, or the electronic device 300 in FIG. 3A) may obtain an image 3020according to a user input from a captured screen 3010, under control ofa processor (e.g., the processor 120 in FIG. 1 ).

In the stage 3001, the electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may determinewhether there is a similar pattern or a grouped screen 3020, 3021 and3022 in a layout of the obtained image 3020, under control of theprocessor (e.g., the processor 120 in FIG. 1 ).

In the stage 3002, the electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) may store the obtained image 3020 together withthe similar pattern or grouped screen 3021 and 3022 existing in thelayout of the obtained image, under control of the processor (e.g., theprocessor 120 in FIG. 1 ). The screen 3021 or 3022 that is not selectedby the user input may also be stored with the image 3020 selected by theuser input.

FIG. 31 illustrates a sequence of an operation of performing an editaccording to a user input by an electronic device (e.g., the electronicdevice 101 in FIG. 1 , the electronic device 200 in FIG. 2A, or theelectronic device 300 in FIG. 3A) according to an embodiment of thedisclosure.

Referring to FIG. 31 , in the stage 3101, an electronic device (e.g.,the electronic device 101 in FIG. 1 , the electronic device 200 in FIG.2A, or the electronic device 300 in FIG. 3A) may obtain a capturedscreen 3110 under control of a processor (e.g., the processor 120 inFIG. 1 ).

In the stage 3103, the electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) may obtain an image 3120 according to a userinput from the captured screen 3110, under control of the processor(e.g., the processor 120 in FIG. 1 ).

According to various embodiments of the disclosure, the operation ofobtaining the image 3120 according to the user input may be an operationof obtaining the image by moving a substantially rectangular and/orsquare end line, or a square or L-shaped bracket image of a “Crop image”user interface 3130 into a threshold region of an object, and selectingthe object region 3120 corresponding to the editing tool user interface3130 having been moved according to the user input.

In the stage 3103, the electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may determinewhether there is a similar pattern or a grouped screen 3120 and 3121 ina layout of the obtained image 3120 under control of the processor(e.g., the processor 120 in FIG. 1 ).

In the stage 3105, the electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) may store, as a new image 3140, both the obtainedimage 3120 and the similar pattern or grouped screen 3120 and 3121existing in the layout of the obtained image, under control of theprocessor (e.g., the processor 120 in FIG. 1 ). The screen 3121 that isnot selected by the user input may also be stored, as the new image3140, with the image 3120 selected by the user input.

FIGS. 32A and 32B are diagrams illustrating a method for operatingcapturing by an electronic device (e.g., the electronic device 101 inFIG. 1 , the electronic device 200 in FIG. 2A, or the electronic device300 in FIG. 3A) according to various embodiments of the disclosure.

Referring to FIGS. 32A and 32B, in the stages 3201, 3203, 3205, and3207, a running application may include horizontal slide images 3210,3220, and 3230.

In the stage 3209, an electronic device (e.g., the electronic device 101in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) may capture a process screen displayed on adisplay (e.g., the display device 160 in FIG. 1 , the display 230 inFIG. 2A, or the display 301 in FIG. 3A) under control of a processor(e.g., the processor 120 in FIG. 1 ). In the stage 3201, the image 3210may be obtained from the captured screen according to a user input.

In the stage 3211, the electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) may merge the horizontal slide images 3210, 3220,and 3230 in a region corresponding to the obtained image 3210, to revisethe captured screen to a new image 3240 and store the new image undercontrol of the processor (e.g., the processor 120 in FIG. 1 ).

FIG. 33 is a diagram illustrating a method for operating capturing by anelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to an embodiment of the disclosure.

Referring to FIG. 33 , in the stage 3301, an electronic device (e.g.,the electronic device 101 in FIG. 1 , the electronic device 200 in FIG.2A, or the electronic device 300 in FIG. 3A) may capture a processscreen 3310 displayed on a display (e.g., the display device 160 in FIG.1 , the display 230 in FIG. 2A, or the display 301 in FIG. 3A) undercontrol of a processor (e.g., the processor 120 in FIG. 1 ).

In the stages 3301 and 3303, the captured screen 3310 may include atleast one object region 3320 and 3330. The electronic device (e.g., theelectronic device 101 in FIG. 1 , the electronic device 200 in FIG. 2A,or the electronic device 300 in FIG. 3A) may determine whether there isthe pop-up object region 3330 in the captured screen 3310, under controlof the processor (e.g., the processor 120 in FIG. 1 ). The pop-up objectregion 3330 may be an Internet advertisement view.

In the stage 3305, the pop-up object region 3330 may be separated andremoved from the captured screen 3310, and the captured screen 3320positioned below the pop-up object region 3330 may be revised. In theoperation of separating the pop-up object region 3330 from the capturedscreen 3310 and revising the captured screen 3310, the pop-up objectregion 3330 is removed, and an image may be revised and stored todisplay the region of interest (ROI) 3320.

FIG. 34 is a diagram illustrating a method for operating capturing by anelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to an embodiment of the disclosure.

Referring to FIG. 34 , in the stage 3401, a captured screen may includeat least one object region 3410 and 3420. The electronic device (e.g.,the electronic device 101 in FIG. 1 , the electronic device 200 in FIG.2A, or the electronic device 300 in FIG. 3A) according to variousembodiments may determine whether there is the pop-up object region 3420in the captured screen, under control of a processor (e.g., theprocessor 120 in FIG. 1 ).

In the stage 3403, the pop-up object region 3420 may be separated andremoved from the captured screen, and the captured screen 3410positioned below the pop-up object region 3420 may be revised. After thepop-up object region 3420 is separated and removed, there may be no dataof at least a partial region 3411 of the captured screen 3410 positionedbelow the pop-up object region 3420. The lost partial region 3411 may becompensated for by using rendering information or extracted additionalinformation, so that the captured screen 3410 positioned below thepop-up object region may be revised. In the operation of separating thepop-up object region 3420 from the captured screen and revising thecaptured screen, the pop-up object region 3420 may be removed, and animage may be revised and stored to display the region of interest (ROI)3410.

FIG. 35 is a diagram illustrating capturing operated by an electronicdevice (e.g., the electronic device 101 in FIG. 1 , the electronicdevice 200 in FIG. 2A, or the electronic device 300 in FIG. 3A)according to an embodiment of the disclosure.

Referring to FIG. 35 , in the stages 3501 and 3503, an electronic device(e.g., the electronic device 101 in FIG. 1 , the electronic device 200in FIG. 2A, or the electronic device 300 in FIG. 3A) may determinewhether an image 3521 which failed to be captured exists at a boundary3520 of a captured image 3510, under control of a processor (e.g., theprocessor 120 in FIG. 1 ).

In the stages 3505 and 3507, if the image 3521 which failed to becaptured exists at the boundary 3520 of the captured image 3510, theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) may separate the image and revise a captured screen to make theimage be a continuous image 3530 under control of the processor (e.g.,the processor 120 in FIG. 1 ).

In the stages 3505 and 3507, if the image 3521 which failed to becaptured exists at the boundary 3520 of the captured image 3510, theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) may separate the image, merge the captured image 3510 and the image3521 which failed to be captured, into a continuous image, and revisethe region of interest 3530 to be a captured screen under control of theprocessor (e.g., the processor 120 in FIG. 1 ). The operation ofrevising the captured screen may be performed by compensating for a dataloss of an image corresponding to a region which failed to be capturedby using rendering information or additional information, to make acontinuous image.

FIG. 36 is a diagram illustrating capturing operated by an electronicdevice (e.g., the electronic device 101 in FIG. 1 , the electronicdevice 200 in FIG. 2A, or the electronic device 300 in FIG. 3A)according to an embodiment of the disclosure.

Referring to FIG. 36 , in the stage 3601, the electronic device (e.g.,the electronic device 101 in FIG. 1 , the electronic device 200 in FIG.2A, or the electronic device 300 in FIG. 3A) is a foldable electronicdevice having a plurality of display regions 3690 and 3691, and maydisplay a plurality of running application screens through a pluralityof multi-windows 3620, 3621 and 3622.

In the stage 3601, each of the plurality of multi-windows 3620, 3621 and3622 may include at least one object region 3610, 3611, 3612, 3613,3614, and 3615.

In the stage 3603, if a command to capture a displayed process screen isreceived, the electronic device may determine, as a region of interest(ROI), the largest object region 3610 among the at least one objectregion 3610, 3611, 3612, 3613, 3614, and 3615 included in the pluralityof multi-windows 3620, 3621 and 3622, and may suggest image editing to auser through an operation of emphasizing a region around the region ofinterest (ROI) 3610 and darkening the region other than the region ofinterest (ROI) 3610. A “Crop image” user interface 3630 may be disposedaround the region of interest (ROI) 3610.

FIG. 37 is a diagram illustrating capturing operated by an electronicdevice (e.g., the electronic device 101 in FIG. 1 , the electronicdevice 200 in FIG. 2A, or the electronic device 300 in FIG. 3A)according to an embodiment of the disclosure.

Referring to FIG. 37 , in the stage 3701, the electronic device (e.g.,the electronic device 101 in FIG. 1 , the electronic device 200 in FIG.2A, or the electronic device 300 in FIG. 3A) is a foldable electronicdevice having a plurality of display regions 3790 and 3791, and maydisplay a plurality of running application screens 3710 through aplurality of multi-windows.

In the stage 3703, each of the plurality of multi-windows may include atleast one object region 3720, and 3750.

In the stage 3703, if a command to capture a displayed process screen isreceived, the electronic device (e.g., the electronic device 101 in FIG.1 , the electronic device 200 in FIG. 2A, or the electronic device 300in FIG. 3A) may determine, as a region of interest (ROI), the largestobject region 3720 among the at least one object region 3720 and 3750included in the plurality of multi-windows, and may suggest imageediting to a user through an operation of emphasizing a region aroundthe region of interest (ROI) 3720 and darkening the region other thanthe region of interest (ROI) 3720. The electronic device (e.g., theelectronic device 101 in FIG. 1 , the electronic device 200 in FIG. 2A,or the electronic device 300 in FIG. 3A) may place a “Crop image” userinterface 3730 around the region of interest (ROI) 3720.

In the stage 3703, the electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) may move the “Crop image” user interface 3730placed around the region of interest (ROI) 3720, from a point 3741 to apoint 3742 which is in a threshold region of the other object region3750, according to a user input.

In the stage 3705, if the “Crop image” user interface 3730 placed aroundthe region of interest (ROI) 3720 is moved from the point 3741 to thepoint 3742 which is in a threshold region of the other object region3750, according to the user input, the electronic device (e.g., theelectronic device 101 in FIG. 1 , the electronic device 200 in FIG. 2A,or the electronic device 300 in FIG. 3A) may capture and store the newimage 3730 including a partial region of the first object region 3720and the second object region 3750.

FIG. 38 is a diagram illustrating capturing operated by an electronicdevice (e.g., the electronic device 101 in FIG. 1 , the electronicdevice 200 in FIG. 2A, or the electronic device 300 in FIG. 3A)according to an embodiment of the disclosure.

Referring to FIG. 38 , in the stage 3801, the electronic device (e.g.,the electronic device 101 in FIG. 1 , the electronic device 200 in FIG.2A, or the electronic device 300 in FIG. 3A) is a foldable electronicdevice having a plurality of display regions 3890 and 3891, and maydisplay a plurality of running application screens A, B, and C through aplurality of multi-windows.

In the stage 3801, each of the plurality of multi-windows may include atleast one object region 3810, 3811, 3812, 3813, 3814, 3815, 3816, 3817,and 3818.

In the stage 3801, each of the plurality of multi-windows may place a“Crop image” user interface 3850 in the at least one object region 3810,3811, 3812, 3813, 3814, 3815, 3816, 3817, and 3818.

In the stage 3803, if a command to capture a displayed process screen isreceived, the electronic device may determine, as a region of interest(ROI), the largest object region 3810 among the at least one objectregion 3810, 3811, 3812, 3813, 3814, 3815, 3816, 3817, and 3818 includedin the plurality of multi-windows, and may suggest image editing to auser through an operation of emphasizing a region around the region ofinterest (ROI) 3810 and darkening the region other than the region ofinterest (ROI) 3810. The “Crop image” user interface 3850 may bedisposed around the region of interest (ROI) 3810.

In the stage 3803, the electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) may move the “Crop image” user interface 3850placed around the region of interest (ROI) 3810, from a point 3861 to apoint 3862 which is in a threshold region of the other object region3811, according to a user input.

In the stage 3805, if the “Crop image” user interface 3850 placed aroundthe region of interest (ROI) 3810 is moved from the point 3861 to thepoint 3862 which is in a threshold region of the other object region3811, according to the user input, the electronic device (e.g., theelectronic device 101 in FIG. 1 , the electronic device 200 in FIG. 2A,or the electronic device 300 in FIG. 3A) may capture and store a newimage 3860 including up to a boundary of the second object region 3811as well as a partial region of the first object region 3810.

FIG. 39 is a diagram illustrating an operation of selecting an objectregion to capture a screen by an electronic device (e.g., the electronicdevice 101 in FIG. 1 , the electronic device 200 in FIG. 2A, or theelectronic device 300 in FIG. 3A) according to an embodiment of thedisclosure.

Referring to FIG. 39 , according to various embodiments of thedisclosure, if an input (e.g., a drag input) of selecting an objectregion according to a touch input made by a stylus pen 320 is received,an electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) may select the object region 3910 according to the touch inputcorresponding to the stylus pen 320, to capture a screen under controlof a processor (e.g., the processor 120 in FIG. 1 ).

FIG. 40 is a diagram illustrating an operation of selecting an objectregion to capture a screen by an electronic device (e.g., the electronicdevice 101 in FIG. 1 , the electronic device 200 in FIG. 2A, or theelectronic device 300 in FIG. 3A) according to an embodiment of thedisclosure.

Referring to FIG. 40 , in the stage 4001, the electronic device (e.g.,the electronic device 101 in FIG. 1 , the electronic device 200 in FIG.2A, or the electronic device 300 in FIG. 3A) may execute a function ofselecting an object region. The electronic device (e.g., the electronicdevice 101 in FIG. 1 , the electronic device 200 in FIG. 2A, or theelectronic device 300 in FIG. 3A) may display a user interface 4010relating to the object region selecting function on a display (e.g., thedisplay device 160 in FIG. 1 ).

In the stages 4003 and 4005, if the object region selecting function isselected, the electronic device (e.g., the electronic device 101 in FIG.1 , the electronic device 200 in FIG. 2A, or the electronic device 300in FIG. 3A) may receive an input of selecting an object region accordingto a touch input (e.g., a touch by a stylus pen or a hand) on a runningscreen 4020, and may display a “Crop image” user interface 4030corresponding to the selected object region.

In the stage 4007, the electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) may capture the object region 4040 selectedaccording to the touch input (e.g., a touch by a stylus pen or a hand).

FIG. 41 is a diagram illustrating an operation of capturing the entirescreen by an electronic device (e.g., the electronic device 101 in FIG.1 , the electronic device 200 in FIG. 2A, or the electronic device 300in FIG. 3A) according to an embodiment of the disclosure.

Referring to FIG. 41 , in the stage 4101, the electronic device (e.g.,the electronic device 101 in FIG. 1 , the electronic device 200 in FIG.2A, or the electronic device 300 in FIG. 3A) according to variousembodiments may display a running process screen 4110 on a display(e.g., the display device 160 in FIG. 1 ).

In the stage 4103, when an input by a combination of multiple buttonkeys (e.g., the input device 150 in FIG. 1 , and the key input device317 in FIGS. 3A and 3B) is received, the electronic device (e.g., theelectronic device 101 in FIG. 1 , the electronic device 200 in FIG. 2A,or the electronic device 300 in FIG. 3A) may capture a displayed screen4420.

FIG. 42 is a diagram illustrating an operation of capturing the entirescreen by an electronic device (e.g., the electronic device 101 in FIG.1 , the electronic device 200 in FIG. 2A, or the electronic device 300in FIG. 3A) according to an embodiment of the disclosure.

Referring to FIG. 42 , in the stage 4201, an electronic device (e.g.,the electronic device 101 in FIG. 1 , the electronic device 200 in FIG.2A, or the electronic device 300 in FIG. 3A) may receive a particulargesture 4210 by a touch input on a display (e.g., the display device 160in FIG. 1 ). For example, the particular gesture by a touch input may bea gesture in which a user swipes the display (or a touch screen) withthe edge or palm of his/her hand in a particular direction.

In the stage 4203, the electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) may capture a displayed screen 4220.

FIG. 43 is a flowchart illustrating a method for operating capturing byan electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to an embodiment of the disclosure.

Referring to FIG. 43 , an electronic device (e.g., the electronic device101 in FIG. 1 , the electronic device 200 in FIG. 2A, or the electronicdevice 300 in FIG. 3A) according to various embodiments may capture ascreen displayed on a display (e.g., the display device 160 in FIG. 1 ,the display 230 in FIG. 2A, or the display 301 in FIG. 3A) under controlof a processor (e.g., the processor 120 in FIG. 1 ), in operation 4301.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may extract at least one regionand/or block region from the captured screen under control of theprocessor (e.g., the processor 120 in FIG. 1 ), in operation 4303.

The electronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may determine whether a command tomodify the captured screen has been received, under control of theprocessor (e.g., the processor 120 in FIG. 1 ), in operation 4305.

If a command to modify the captured screen is received, the electronicdevice (e.g., the electronic device 101 in FIG. 1 , the electronicdevice 200 in FIG. 2A, or the electronic device 300 in FIG. 3A)according to various embodiments may determine whether a region ofinterest (ROI) exists in the captured screen, based on the extracted atleast one region and/or block region under control of the processor(e.g., the processor 120 in FIG. 1 ), in operation 4307.

If a region of interest (ROI) exists in the captured screen, theelectronic device (e.g., the electronic device 101 in FIG. 1 , theelectronic device 200 in FIG. 2A, or the electronic device 300 in FIG.3A) according to various embodiments may display a user interface forsuggesting the region of interest (ROI) on the display (e.g., thedisplay device 160 in FIG. 1 ) under control of the processor (e.g., theprocessor 120 in FIG. 1 ), in operation 4309.

According to various embodiments of the disclosure, the user interfacefor suggesting the region of interest (ROI) may be, for example, a GUIelement related to highlight, inversion, a box, and/or an icon.

The electronic device according to various embodiments may be one ofvarious types of electronic devices. The electronic devices may include,for example, a portable communication device (e.g., a smart phone), acomputer device, a portable multimedia device, a portable medicaldevice, a camera, a wearable device, or a home appliance. The electronicdevice according to embodiments of the disclosure is not limited tothose described above.

It should be appreciated that various embodiments of the disclosure andthe terms used therein are not intended to limit the technologicalfeatures set forth herein to particular embodiments and include variouschanges, equivalents, and/or alternatives for a correspondingembodiment. With regard to the description of the drawings, similarreference numerals may be used to designate similar or relevantelements. It is to be understood that a singular form of a nouncorresponding to an item may include one or more of the things, unlessthe relevant context clearly indicates otherwise. As used herein, eachof such phrases as “A or B,” “at least one of A and B,” “at least one ofA or B,” “A, B, or C,” “at least one of A, B, and C,” and “at least oneof A, B, or C,” may include all possible combinations of the itemsenumerated together in a corresponding one of the phrases. As usedherein, such terms as “a first”, “a second”, “the first”, and “thesecond” may be used to simply distinguish a corresponding element fromanother, and does not limit the elements in other aspect (e.g.,importance or order). It is to be understood that if an element (e.g., afirst element) is referred to, with or without the term “operatively” or“communicatively”, as “coupled with,” “coupled to,” “connected with,” or“connected to” another element (e.g., a second element), it means thatthe element may be coupled with the other element directly (e.g.,wiredly), wirelessly, or via a third element.

As used herein, the term “module” may include a unit implemented inhardware, software, or firmware, and may be interchangeably used withother terms, for example, “logic,” “logic block,” “component,” or“circuit”. The “module” may be a minimum unit of a single integratedcomponent adapted to perform one or more functions, or a part thereof.For example, according to an embodiment of the disclosure, the “module”may be implemented in the form of an application-specific integratedcircuit (ASIC).

Various embodiments as set forth herein may be implemented as software(e.g., the program 140) including one or more instructions that arestored in a storage medium (e.g., internal memory 136 or external memory138) that is readable by a machine (e.g., the electronic device 101).For example, a processor (e.g., the processor 120) of the machine (e.g.,the electronic device 101) may invoke at least one of the one or moreinstructions stored in the storage medium, and execute it, with orwithout using one or more other components under the control of theprocessor. This allows the machine to be operated to perform at leastone function according to the at least one instruction invoked. The oneor more instructions may include a code generated by a complier or acode executable by an interpreter. The machine-readable storage mediummay be provided in the form of a non-transitory storage medium. Wherein,the term “non-transitory” simply means that the storage medium is atangible device, and does not include a signal (e.g., an electromagneticwave), but this term does not differentiate between where data issemi-permanently stored in the storage medium and where the data istemporarily stored in the storage medium.

According to an embodiment of the disclosure, a method according tovarious embodiments of the disclosure may be included and provided in acomputer program product. The computer program product may be traded asa product between a seller and a buyer. The computer program product maybe distributed in the form of a machine-readable storage medium (e.g.,compact disc read only memory (CD-ROM)), or be distributed (e.g.,downloaded or uploaded) online via an application store (e.g., PlayStore), or between two user devices (e.g., smart phones) directly. Ifdistributed online, at least part of the computer program product may betemporarily generated or at least temporarily stored in themachine-readable storage medium, such as memory of the manufacturer'sserver, a server of the application store, or a relay server.

According to various embodiments of the disclosure, each element (e.g.,a module or a program) of the above-described elements may include asingle entity or multiple entities. According to various embodiments ofthe disclosure, one or more of the above-described elements may beomitted, or one or more other elements may be added. Alternatively oradditionally, a plurality of elements (e.g., modules or programs) may beintegrated into a single element. In such a case, according to variousembodiments of the disclosure, the integrated element may still performone or more functions of each of the plurality of elements in the sameor similar manner as they are performed by a corresponding one of theplurality of elements before the integration. According to variousembodiments of the disclosure, operations performed by the module, theprogram, or another element may be carried out sequentially, inparallel, repeatedly, or heuristically, or one or more of the operationsmay be executed in a different order or omitted, or one or more otheroperations may be added.

While the disclosure has been shown and described with reference tovarious embodiments thereof, it will be understood by those skilled inthe art that various changes in form and details may be made thereinwithout departing from the spirit and scope of the disclosure as definedby the appended claims and their equivalents.

What is claimed is:
 1. A method for operating capturing by an electronicdevice, the method comprising: capturing a screen displayed on adisplay; extracting an image region containing an image from thecaptured screen as distinguishable from a text region in the capturedscreen; receiving a command to modify the captured screen; in responseto receiving the command to modify the captured screen, displaying auser interface including a first indication for indicating a region ofinterest (ROI) in the captured screen, based on the extracted imageregion, and a second indication for indicating a full screen region inthe captured screen, wherein the user interface is configured to enableselection of one of the extracted image region included in the ROI orthe full screen region in the captured screen; in response to selectionof the extracted image region included in the ROI, enabling amodification of the ROI; and in response to selection of the full screenregion, enabling a modification of the full screen region.
 2. The methodof claim 1, wherein the displaying of the user interface comprisesmaintaining a view layout of the captured screen while displaying theuser interface for indicating the ROI for a pre-configured timeinterval.
 3. The method of claim 2, wherein the user interface forindicating the ROI comprises a graphical user interface (GUI) elementrelated to highlight, inversion, a box, and/or an icon.
 4. The method ofclaim 1, further comprising: determining whether the ROI is selected;and based on determining that the ROI is selected, displaying a firstedit screen.
 5. The method of claim 4, further comprising: based ondetermining that the ROI is not selected, displaying a second editscreen.
 6. The method of claim 4, wherein the first edit screencomprises an edit screen in which a view layout of the captured screenis maintained while an editing tool user interface is placed to centeron the ROI.
 7. The method of claim 5, wherein the second edit screencomprises an edit screen in which a view layout of the captured screenis maintained while an editing tool user interface is placed to centeron an entire screen.
 8. The method of claim 4, further comprising:determining whether there is editing according to a user input.
 9. Themethod of claim 8, wherein the editing according to the user inputcomprises: moving an editing tool user interface according to the userinput to modify the first edit screen to an edited screen desired by auser in the captured screen; and storing the edited screen as an image.10. The method of claim 9, further comprising: based on determining thatthe editing tool user interface reaches a threshold region of an objectregion while the editing tool user interface is being moved by the userinput, snapping to the object region.
 11. An electronic devicecomprising: a display; a processor operatively connected to the display;and a memory operatively connected to the processor, wherein the memorystores instructions which, when executed, cause the processor to:capture a screen displayed on a display, extract an image regioncontaining an image from the captured screen as distinguishable from atext region in the captured screen, receive a command to modify thecaptured screen, in response to receiving the command to modify thecaptured screen, display a user interface including a first indicationfor indicating a region of interest (ROI) in the captured screen, basedon the extracted image region, and a second indication for indicating afull screen region in the captured screen, wherein the user interface isconfigured to enable selection of one of the extracted image regionincluded in the ROI or the full screen region in the captured screen, inresponse to selection of the extracted image region included in the ROI,enable a modification of the ROI, and in response to selection of thefull screen region, enable a modification of the full screen region. 12.The electronic device of claim 11, wherein the instructions are furtherconfigured to cause the processor to maintain a view layout of thecaptured screen while displaying the user interface for indicating theROI for a pre-configured time interval.
 13. The electronic device ofclaim 12, wherein the user interface for indicating the ROI comprises agraphical user interface (GUI) element related to highlight, inversion,a box, and/or an icon.
 14. The electronic device of claim 11, whereinthe instructions are further configured to cause the processor to:determine whether the ROI is selected, and when the ROI is selected,display a first edit screen on the display.
 15. The electronic device ofclaim 14, wherein the instructions are further configured to cause theprocessor to, when the ROI is not selected, display a second edit screenon the display.
 16. The electronic device of claim 14, wherein the firstedit screen is an edit screen in which a view layout of the capturedscreen is maintained while an editing tool user interface is placed tocenter on the ROI.
 17. The electronic device of claim 15, wherein thesecond edit screen is an edit screen in which a view layout of thecaptured screen is maintained while an editing tool user interface isplaced to center on an entire screen.
 18. The electronic device of claim14, wherein the instructions are further configured to cause theprocessor to: determine whether there is editing according to a userinput.
 19. The electronic device of claim 18, wherein the instructionsare further configured to cause the processor to: move an editing tooluser interface according to the user input to modify the first editscreen to an edited screen desired by a user in the captured screen, andstore the edited screen as an image.
 20. The electronic device of claim19, wherein the instructions are further configured to cause theprocessor to, when the editing tool user interface reaches a thresholdregion of an object region while the editing tool user interface isbeing moved by the user input, snap to the object region.